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continuous  extrapolation,  (ii)  We  propose  four  basic  models  for  the  extrapola¬ 
tion  problem  and  we  present  some  new  techniques  for  solving  the  continuous  ex¬ 
trapolation  problem  when  the  known  part  of  the  signal  is  contaminated  with 
noise,  (ill)  Several  results  concerning  Iterative  algorithms  for  band-limited 
extrapolation  are  presented^ 
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PREFACE 


This  technical  report  consists  of  four  parts.  The  central  problem 
Is  the  extrapolation  of  band-limited  signals. 

In  Part  I,  we  show  that  time-limited  signal  restoration  can  be  ac¬ 
complished  by  computing  fixed  point  solutions  by  means  of  a  certain 
iterative  procedure.  An  application  to  extrapolation  is  shown. 

In  Part  II,  a  method  is  presented  for  obtaining  discrete  extrapolations 
of  a  finite  extent  sequence.  The  convergence  of  the  discrete  extrapolation 
to  the  continuous  extrapolation  when  the  sampling  rate  tends  to  infinity 
is  shown. 

In  Part  III,  several  results  concerning  the  case  where  noise  is 
present  in  the  known  part  of  the  signal  are  presented.  We  also  present 
4  basic  models  for  extrapolation  and  discuss  their  relationships. 

In  Part  IV,  the  connection  between  the  well-known  iterative  procedure 
for  band-limited  extrapolation  (Papoullp-Gerchberg)  is  shown  to  be  a  special 
case  of  a  more  general  procedure  given  by  Landweber  in  1951.  The  relation¬ 
ship  between  discretization  of  the  Landweber  procedure  and  some  of  the 
techniques  given  in  Part  II  is  discussed. 
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ITERATIVE  TIME-LIMITED  SIGNAL  RESTORATION 


Jorge  L.  C.  Sanz 
Thomas  S.  Huang 


Coordinated  Science  Laboratory 
University  of  Illinois  at  Urbana-Chai^algn 
1101  W.  Springfield  Avenue 
Urbana,  Illinois  61801 


ABSTRACT 

The  purpose  of  this  paper  Is  to  show  that  tlme-llmlted  restoration  of 
shift-invariant  blurred  signals  can  be  done  by  means  of  fixed  point  solutions 
of  contraction  mappings,  under  rather  general  conditions  for  the  distortion 
operator.  All  our  results  are  valid  for  multidimensional  signals.  An  appli¬ 
cation  of  these  results  to  the  Iterative  extrapolation  of  band-limited 
discrete  Images  Is  shown. 


I.  INTRODUCTION 


Many  problems  In  signal  restoration  can  be  formulated  In  the  following 
manner:  Find  a  sequence  x(n)»  -«  <  n  <  -H>>,  such  that 

+* 

y(n)  ■  I  h(n,m)x(m),  -<»  <  n  <  +"  (1) 

m«-<» 

x(n)  »  (Cx)(n) 

where  C  Is  a  constraint  operator,  y:y(n),  -«  <  n  <  4o>  Is  the  observed  signal 
and  h:h(m,n),  -«  <  m,  n  <  +«  Is  a  known  distortion  operator. 

An  attempt  to  solve  (1)  Is  to  seek  solutions  of  the  following  equation: 

x(n)  «  Xy(n)  +  ((Cx)(n)  -  X  I  h(n,m) (Cx) (m))  (2) 

or  equivalently.  If  we  choose  functional  notation,  to  look  for  the  fixed 
points  of  the  operator  G  : 

G^(x)  -  Xy  +  (I  -  XH)  Cx  (2') 

where  y  denotes  the  observed  sequence,  and  I  and  H  denote  the  Identity  operator 
and  the  distortion  operator,  respectively.  The  motivation  Is  that  (2)  prompts 
the  Iterative  computation  of  the  fixed  points  by  means  of  the  recursion  formula: 

x^"^^  -  Xy  +  (I  -  XH)  Cx'^  (3) 

x^  «  Initial  guess 

(Note  that  the  superscripts  do  not  denote  powers.) 

Several  authors  have  used  this  methodology  for  solving  (1).  Reference  [1] 
provides  an  excellent  review  of  this  matter.  The  reader  Is  referred  also  to 
[1]  for  a  list  of  references.  Another  relevant  paper  Is  [2]. 


In  solving  the  restoration  problem  by  means  of  the  Iterative  equation  (3) 


three  problems  arise.  The  first  Is  to  find  convergence  properties  for  the 
Iterative  scheme.  The  second  problem^  vhlch  ve  consider,  conceptually  to 
be  a  much  more  Important  problem.  Is  that  of  relating  the  fixed  points  of  (2') 
with  the  original  problem  (1) .  The  third  problem  is  the  effect  of  noise  In 
the  observed  signal  on  the  fixed  points  of  equation  (2) . 

It  Is  clear  that  any  solution  of  (1)  Is  a  fixed  point  of  (2*),  but  there 
Is  no  reason  to  believe  that  the  converse  holds  In  general;  l.e.,  for  some  H 
and  C  there  may  be  fixed  points  of  (2*)  which  are  not  solutions  of  (1)  at  all. 

Let  us  give  an  example.  If  we  put  (A  <  ir) 


,  ^  ^  sin  A(n-m)  , 

h(n,m)  - .  . —  if  n  m 

irCn-m) 

« 

h(a,n)  -  ^ 

IT 

and  If  we  consider  a  time-limiting  operator  as  the  constraint  T: 


T(x)(n)  •  0  if  n  ^  ^"a’“b^ 
T(x)(n)  »  x(n)  if  n  e 


then  a  necessary  condition  for  (1)  to  have  a  solution  Is  that  y(u)  (the 

t  aa 

Inu 


Fourier  transform  I  y(n)e'““"  of  the  sequence  y(n))  be  of  the  form 
%  iiuo 

I  z(n)e  uhen  u  e  (-A,A)  and  0  when  |co|  >A.  Now  If  we  assume  that 
n-n 

y(nT  does  not  have  that  property,  then  no  solutions  of  (1)  can  exist. 


(4 


Nevertheless,  as  we  will  prove  later,  \  may  be  chosen  such  that  (2')  Is  a 
contraction  mapping.  This  assures  that  the  fixed  point  will  exist  no  matter 
what  y(n)  Is. 


We  think  that  this  asstanption  about  y(n)  is  very  realistic  since  y  may 
contain  some  noise,  and  in  that  case  its  Fourier  transform  might  be  very 

D  inti) 

different  from  a  finite  trigonometrical  polynomial  (i.e.  1  z(n)«e  )  on 

n«n 

a 

(-A,A).  This  shows  that  by  means  of  (2)  we  would  be  solving  a  rather  different 
problem  from  that  of  (1) . 

In  the  case  that  (1)  has  at  least  one  solution  and  X  may  be  chosen  such 
that  the  operator  (2')  has  a  unique  fixed  point,  then,  of  course,  the  fixed 
point  is  the  unique  solution  of* (1) . 

With  respect  to  the  first  problem  mentioned  above,  it  is  worth  noting 
that  Youla  [3]  has  shown  some  interesting  properties  that  assure  the  iterative 
procedure  (3)  to  be  convergent  when  X  •  1,  H  and'C  are  projection  operators 
onto  closed  linear  manifolds  in  a  Hilbert  space. 

The  third  problem  to  be  considered  is  the  stability  of  the  method  to  be 
chosen  for  solving  (1),  In  our  case,  solving  (2)  is  the  chosen  technique. 

As  we  have  already  pointed  out,  (1)  is  frequently  a  very  poorly  conditioned 
problem  since  small  amounts  of  noise  added  to  the  observation  y(n)  may  make 
(1)  not  have  any  solution.  It  would  be  desirable  that  this  was  not  the  case 
with  (2),  and,  if  possible,  it  would  be  even  better  to  be  able  to  estimate  how 
much  the  solutions  of  (2)  will  change  when  some  noise  is  added  to  y(n) . 

A  satisfactory  solution  to  all  these  problems  may  be  obtained  when  (2’) 
is  a  contraction  mapping,  i.e.,  when  there  exists  a  real  number  d  <  1  such 
that 

I  G(x)  -  G(x)II  s  d  ||x  -  x|l  ,  for  all  x,  x  .  (5) 

If  (5)  holds,  then  the  iterative  scheme  (3)  is  convergent,  the  fixed  point 


(2)  has  to  be  unique,  and  It  Is  also  known  that  if  we  add  some  noise  Ay  to 
y,  we  will  have: 


z 


(6) 


where  z  and  z  are  the  fixed  points  corresponding  to  the  noise-free  and  noisy 
observations,  respectively,  l.e.: 


z  -  Xy  +  (I  -  XH)Cz 

and 

z  «  X(y  +  Ay)  +  (I  -  XH)Cz 


It  is  important  to  note  that  if  d  =■  1  (i.e.,  G  is  a  non-expansive  mapping) 

then  equation  (6)  will  not  hold.  However,  for  some  special  G’s,  the  iterative 

« 

scheme  (3)  is  convergent,  (see  [2]) 

In  addition,  we  can  obtain  a  noise-sensitivity  analysis  for  the  recursion 
(3).  Let  us  put: 

z”  =  Xy  +  (I  -  XH)  Cz^  z°  =  initial  guess 

and 

z"  *  X(y  +  Ay)  +  (I  -  XH)C  2°  »  initial  guess. 

Then,  we  get 

I  -  *"||  S  |xl  II  iyl  +  II 1°  -  J°|  d"  (7) 

i-0 

(where  d^  denotes  the  ith  power  of  d) 

We  think  it  is  very  important  to  point  out  that  the  constant  d  will  depend 
on  the  parameter  X.  Then,  it  is  interesting  to  choose  X  in  order  to  minimize 
the  noise-sensitivity  ratio: 

JiL 

1  -  d 


Sometimes,  this  amount  is  minimized  by  choosing  X  •  0,  and  d  approaches  1 
when  X  tends  to  0;  this  means  that  there  is  a  trade-off  between  noise  sensi¬ 
tivity  reduction  and  speed  of  convergence,  since  the  smaller  d  is,  the  faster 
the  convergence  z,  as  it  follows  from 

II  z"-  zll  ^  d  II  “  z||  • 

Two  important  classes  of  problems  are: 

A.  H  is  a  convolution  operator: 

(Hx) (n)  ®  (h*x) (n)  ®  E  h(m,n)x(m)  , 

m*— OP 

In  this  case,  the  composition  of  time-limiting  operator  defined  in  (4')  and 
any  non-linear  non-expansive  mapping  will  be  the  constraint  operator. 

B.  H  is  a  linear  non-negative  time-variant  operator 

+« 

(Hx) (m)  ■  E  h(m,n)x(n)  , 
n»-« 

h(m,n)  i  0,  for  all  n,m 


Here,  the  constraint  to  be  considered  is  non-negative  time-limited  signals, 
i.e. : 


(Px)  (n) 


x(n)  if  x(n)  a  0  and  n  e  [n^,n^] 
0  otherwise 


In  either  case  A  or  B  we  can  prove  that  there  exists  some  real  number 
such  that 


V,  '  Xy  +  (I  -  XH)Cx 


where  d  Is  a  constant  which  verifies  d  <  1,  by  imposing  some  additional, 
rather  general  conditions  on  H.  Note  that  in  case  A,  (8)  Implies  (5).  .This 
is  not  true  for  case  B.  Therefore,  in  the  remainder  of  this  paper  case  B  will 
not  be  considered.  Nevertheless,  a  proof  of  (8)  for  case  B  is  Included  in 
Appendix  II,  because  we  believe  that  the  result  may  be  useful  in  its  own  right. 

Section  II  summarizes  the  main  results.  In  section  III,  an  application 
of  the  shift  invariant  case  will  be  given.  Specifically,  we  will  show  that 
the  iterative  procedure  (3)  can  be  used  for  obtaining  an  iterative  extrapola¬ 
tion  of  a  discrete  band-limited  multidimensional  signal.  This  result  extends 
those  recently  given  in  [5] . 

Section  IV  presents  some  discussions  on  the  iterative  restoration  tech-, 

nique  given  by  (3)  when  the  constraint  operator  is  a  truncation  to  [n  ,n,  ]  and 

a  b 

the  given  signal  is  corrupted  with  noise.  We  also  show  how  the  results  obtained 
in  Section  II  provide  theoretical  support  for  some  of  the  results  in  [I]. 


1.8 


II.  MAIN  RESULTS 

In  this  section  we  will  state  our  main  results.  All  the  proofs  are 
given  In  Appendix  I. 

Let  T  denote  the  time-limiting  operator  over  defined  in  (4') 

and  5  be  the  unit  sample  sequence:  5(0)  *  1;  5(n)  »  0,  n  0. 

Theorem  1 


Let  h:h  >  -<»<n<+<*>bea  finite-energy  sequence,  and  let  T  be  a  subset 
n 

of  [-• ir,ir]  of  non-zero  measure.  Let  us  suppose  that  h  has  the  following 
property:  there  is  a  number  K  and  there  exists  some  real  constant  \  such  that 


1  -  Xfi(a))|  1,  for  all  m  e  [-it, it]. 


1  -  Xh(a))l  i  K  <  1,  for  all  to  e  T. 


Then,  it  follows  that  we  can  find  a  constant  M  <  1  such  that: 


11(5  -  Xh)  *  Txf  i  M  11  Tx 


for  all  infinite  sequences  x:  x(n),  -«  <  n  <  +». 

Conditions  (a)  and  (b)  of  Theorem  1  may  be  satisfied  under  rather  general 
conditions  for  the  kernel  h:h  ,  -a.  <  n  <  +<»  (Theorem  3)  .  Since  the  operator 

Cl 

(5  -  Xh)*T  is  linear.  Theorem  1  also  ensures  that  (5  -  Xh)*T  is  a  contraction 
mapping.  Therefore,  we  have  the  following 

Corollary 

With  the  same  notation  as  in  Theorem  1,  and  under  the  same  conditions 
for  h;  h(n),  -«  <  n  <  »,  there  exists  a  real  number  X  such  that  the  operator: 


(5  -  Xh)*T 


is  a  contraction  mapping. 


1.: 


Another  Important  result  which  can  be  Immediately  obtained  from  Theorem  1 
Is  the  following: 

Theorem  2 

With  the  same  conditions  and  notations  as  In  Theorem  1,  If  we  assume  In 
addition  that  C  Is  any  nonexpanslve  operator: 

II  C  X  -  C  xi  <  I  X  -  x||  , 


then,  the  operator 


(6  -  Xh)*TC 

Is  a  contraction  mapping,  for  some  real  number  X. 

A  particular  case  of  Theorem  2  Is  when  C  Is  the  positive  constraint 
operator  defined  by 


Px(n) 


x(n).  If  x(n)  >  0 
0  otherwise. 


Since  this  operator  Is  nonexpanslve.  Theorem  2  holds. 

It  Is  Important  to  find  what  conditions  h  should  satisfy  In  order  to 
meet  conditions  (a)  and  (b)  In  Theorem  1. 

Let  us  begin  with  an  important  example.  We  consider  the  frequency-  . 
limiting  operator  SINC^  defined  in  (4).  Since  its  Fourier  transform  is 

f  1  if  0)  E  (-A,A) , 


we  have 


0  otherwise. 


(We  are  looking  at  the 
interval  [-Tr,ir]  only.) 


K 


|l  -  if  «»>  d  (“A, A) 

|l  -  Xx^(a))|  “  |l  -  X],  if  0)  e  (-A,A) 

This  means  that  any  X  e  (0>2)  satisfies  both  requirements  (a)  and  (b)  of 
Theorem  1,  with  K  a  |l  -  x(  and  P  •  (-A»A).  For  any  such  X,  we  have  that 

(6  -  X  SINC^)*TC 

Is  a  contraction  mapping,  for  any  nonexpanslve  operator  C,  as  It  has  been 
stated  In  Theorem  2. 

The  next  theorem  shows  that  there  exist  many  other  sequences  which  satisfy 
conditions  (a)  and  (b) . 

Theorem  3 

Let  H  be  a  complex-valued  function  defined  over  [-iTfir]. 

(I)  If  H  has  the  following  properties: 

la.  u:  ReH(u)  *  0  HCu)  *0 

lb.  u:  ReH(u)  j*  0  -*■  ReH(u)  >  M  >  0. 

lc.  |H((i))|  Is  bounded,  when  at  e 
or 

(II)  If  H  has  the  following  properties: 

lla.  H(u)  *  ReH(u)  0  for  all  u  e  [-ir,::]. 

llb.  H(u)  Is  bounded,  u  e  ['■v,?]. 

lie.  There  exist  a  subset  S  of  and  a  constant  M  such  that 

H(u)  ^  M  >  0,  when  oj  e  S. 

Then,  In  either  case,  there  exist  some  real  numbers  X  and  K,  and  a  set 
r  C  : 


(a)  jl  -  XH((»))I  <  1,  for  all  u  e  [-ir.ir]. 

(b)  |l  -  XH(u)l  s  K  <  1,  for  all  u  e  F. 


In  Theorem  3,  when  H  plays  Che  role  of  Che  Fourier  Cransform  of  a  flnlce- 


III.  APPLICATIONS 


First  of  all,  we  would  like  to  point  out  some  aspects  related  to  the 
Iterative  restoration  approach  for  the  multidimensional  case. 

Basically,  the  main  results  given  In  Section  II  may  be  extended  to  the 
multidimensional  case.  Nevertheless,  due  to  the  nature  of  the  problem,  in 
multiple  dimensions  the  time-limiting  operator  becomes  much  richer  than  in 
the  1-d  case,  even  though  all  the  results  In  Sections  II  and  III  concerning 
the  1-d  problem  can  be  extended  to  the  case  In  which  the  time -limiting 
operator  T  is  defined  with  respect  to  any  bounded  set  of  Integer  numbers. 

We  will  consider  the  2-d  case  without  losing  generality,  and  we  will 
state  the  two-dimensional  version  of  only  Theorem  1.  Later  In  this  Section 
we  will  show  an  application  of  Theorem  1  for  the  multidimensional  case.  To 
establish  some  notation  we  state: 


Theorem  4 


Let  h:  h(nj^,n2),  -*  <nj^,n2'<  +  *  be  a  finite-energy  sequence,  and  F  be  a 
subset  of  x  [-TT,rr]  «diich  contains,  at  least,  an  open  set.  Let  us 

suppose  that  h  has  the  following  property:  There  is  a  number  k  and  there 
exists  some  real  constant  \  such  that: 


l-\h  (u>j^,uj2)|  S  1,  for  all 
1-lh  (u}j^,(U2)(  s  k  <  1,  for  all  (u)j^,(ju2) 


Then,  it  follows  that  we  can  find  a  constant  M  <  1  such  that : 


i!  (02  -X  h  )  *  E^i  S  Mil  E^x'l 


where  is  given  by: 

if  (n^^.n^)  e 

E^CxXn^.n^) 

0  otherwise , 

x:  xCn^^jn^)  -«  <  <  +«6  is  any  2-dimensional  sequence, 

6^  denotes  the  2-d  unit  saiiq>le:  ^  ^  otherwise. 

The  proof  of  this  theorem  is  analogous  to  the  1-d  case  and  will  be  omitted. 
However,  it  is  worth  saying  that  this  2-d  result  is  not  obtained  by  using 
the  1-d  Theorem  1  with  separability  arguments  or  by  stacking  the  2-d  sequences 
into  vectors.  It  is  also  Important  to  note  that  C.  need  not  be  a  square  or  a 
rectangle. 

Similar  conditions  to  those  of  Theorem  3  may  be  derived  for  more  dimensions. 
As  an  example,  let  us  write  the  2-d  low-pass  operator 

SINC^^g(n^,n2)  -  SINC^(n^).  SINCg(n2) 

The  frequency  response  is : 

1  if  (u)j^,u)2)  6  AxB 
0  otherwise 

In  that  case,  given  X.  €  (0,2)  and  F  »  AxB,  we  have  the  hypothesis  of  Theorem  4 
satisfied,  and  therefore 

(8j-X.  SINC^y*E^ 

is  a  contraction  mapping. 

This  particular  example,  as  well  as  its  1-d  counterpart,  has  been  shown 
to  lead  to  iterative  algorithms  for  the  extrapolation  of  a  band-limited  dis¬ 
crete  signal,  given  a  finite  number  of  known  values  of  the  signal.  In  our 
results,  the  known  samples  of  the  signal  need  not  form  a  square  (in  Che  2-d 


case)  and  need  not  be  consecutive  (In  the  1-d  case) .  These  results  extend 
those  recently  given  In  [5].  In  addition,  since  the  sequence  h  In  Theorem  4 
Is  more  general  than  SINC^  ^  as  defined  above,  this  two-dimensional  version 
of  Theorem  1  Is  useful  to  provide  some  other  band-limited  extrapolations  of 
the  given  Image.  For  a  more  detailed  discussion  of  this  subject  matter  the 
reader  is  referred  to  [4],  [5].  One  basic  tool  in  our  extrapolation  technique 
consists  of  solving  the  system  of  equations: 

z(n^,n2)  *  (h*^x)(n^,n2).  (nj^,n2)  e  d  (9] 

where  z(n^,n2),  (nj^,n2)  e  d  are  the  values  of  the  known  part  of  the  Image, 
and  h  Is  any  two-dimensional  sequence  which  satisfies  the  hypothesis  of 
Theorem  4.  It  is  also  assumed  that  h  is  band-limited  to  0  C  [—it, it]  x  [-it, it], 

l.e., 

h((0j^,(i)2)  ■  ^  ^  h(nj^,n2)  a  o 

.nj^eZ  n2eZ 

if  (u)^,oj2)  % 

Theorem  4  provides  an  iterative  procedure  for  solving  (9)  and  a  rationale  for 
choosing  \  Independently  o£^:  the  two-dimensional  sequence 

k-t-l  k 

X  +  (^2  -  Xh)*E^  x**-  (10) 

Since  (^2  “  Xh)*E^  Is  a  contraction  mapping,  the  convergence  of  (10)  is 
ensured.  If  x  denotes  the  limit  of  the  procedure.  It  Is  easy  to  verify: 

E^^x  ■  XE^z  +  E^^(E^x  -  Xh*Ejx) 


and  since  E.-E^x  ■  E.^x,  we  conclude 


zCtij^.n^)  -  (h*%x)(nj^,n2),  (nj^,n2)  e  O. 

Three  Important  remarks  are  In  order:  1.  The  low-pass  operator  h  need  not  be 

the  function  SING.  ..  2.  The  pass-band  of  h  need  not  be  a  rectangle  (the  same 

A»o 

observation  also  applies  to  the  set  where  the  signal  Is  known: ^).  3.  The 

parameter  X  can  be  chosen  Independently  of 

To  end  this  section,  we  would  like  to  point  out  that  different  h's 
provide  different  extrapolations  of  the  known  data,  z(n^,n2),  (n^,n2)  e  Q. 

This  flexibility  Is  exploited  In  [4]. 


IV.  DISCUSSIONS 


In  connection  with  the  problems  we  address  In  this  paper,  we  would  like 
to  point  out  some  loose  ends  found  In  Section  III.C  of  [1].  In  [1]  It  was 
proven  that  the  operator 

(6  -  X  h  )  *T  dl) 

Is  nonexpanslve,  for  some  values  of  X,  when  h  satisfies 

|l-Xh(u))|si,  for  all  cu6  [  -  n  ,  tt  ]  .  (12) 

the  authors  pointed  out  that  If  Re  h  Is  non-negative,  then  X  may  be  chosen 
to  meet  the  condition  (12).  We  think  that  this  assertion  may  not  hold  In 
general.  Let  us  suppose  that  there  exists  a  set  0 c  [  -  tt  ,  n  ]  such  that 

h  (  w  )  ■  j  •  Imh  (  u) )  ,  0)  6  0  , 

In  this  case,  there  Is  no  X  that  satisfies  (12),  unless  X  »0  . 

With  respect  to  the  operator  (ll) ,  the  authors  of  [1]  suggested  that  some 
other  constraint  should  be  added  to  make  It  a  contraction  mapping,  or  at  least, 
to  make  the  corresponding  Iterative  procedure  converge.  We  have  proven  In 
this  paper  that  this  Is  not  necessary  (Theorem  1). 

In  [1] ,  It  is  proved  that  when  the  convolution  operator  Is  given  by 

SINC^,  and  when  the  constraint  Is  a  composition  of  T  and  P,  the  Iterative  scheme 

x^  -  X  y+  (6  -X  SINC^)  *  TPx^"^,  x°  -  X  y  (13) 

converges,  when  X€  (0,2).  We  think  that  the  proof  Is  not  rigorous  even  though 

the  assertion  Is  correct  (Immediate  corollary  of  our  Theorem  2  when  C  Is  the  posi¬ 
tivity  constraint  P,  which  assures  that  (6  -XSINC^)  *TP  Is  a  contraction  map-  | 

ping).  In  [1],  the  argument  used  Is  that  at  each  step  of  the  Iterative  proce- 
k 

dure  (13),  the  x  does  not  satisfy  the  constraint  TPx*  x  except,  eventually, 
in  the  limit  when  k  **  «.  Therefore  I 
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with  0  <  <  1.  It  Is  very  important  to  point  out  that  r^  depends  on  k. 

Let  us  write  r^ (k)  to  make  that  dependency  explicit.  This  means  that 

11  -  x^l  «  n  r^  (m)  llx^-x°ll 

m-1 

k 

There  is  no  reason  to  believe  that  II  r.  (m)  0  when  k  "•'  <». 

m-1 

A  related  point  is  in  connection  with  the  relation 


Tx-Tz1p-  l]lx-zlr. 


where  L  -  1  - 


Z  |x(n)  -z(n)| 
n^fna.nb] 


It  has  been  asserted  that  HTx-TzU  -  Hx-zH,  if  and  only  if  z  and  x  are  zero 
outside  [n^,n^] ,  which  is  not  quite  true  since  any  two  sequences  x  and  z 
which  coincide  outside  satisfies  L  -  1  (we  assume  x  ^  z  outside 

[na,nb] ) . 

We  cqnclude  this  paper  by  pointing  out  some  important  issues  related  to 
the  application  of  the  iterative  procedure 

-  Xy  +  (I  -  XH)Cx'^  (3) 

to  restoration.  Let  us  assume  that  C  »  DT  (where  T  is  the  time-limiting 
constraint)  then  we  can  write  (3)  as 


-  Xy  +  (I  -  XH)DTx'^ 


C 


A  careful  look  at  (14)  shows  that  in  each  step,  the  new  estimation  x 

Ic  Ic 

uses  the  values  Tx  of  x  only.  This  means  that  if  the  Iteration  converges: 

X  -^x  the  following  iteration: 

k+1  k 

T  X  -  XTy  +  T(I  -  •XH)DTx  (15) 

will  also  converge,  and  the  limit  will  be  Tx.  Let  us  suppose  that  all  the 
necessary  conditions  are  satisfied  so  that  Tx  will  be  the  solution  to  our 
problem: 

y  -  Hx 

X  »  Tx,  X  »  Dx  (16) 

In  that  case,  it  is  clear  from  our  analysis  that  the  only  information  that 

(14)  (or  equivalently  (15))  is  using  from  the  available  data  is  Ty,  that  is 

y(n),  n  e  [n  ,n.  ].  However,  this  is  a  characteristic  of  the  iterative  approach 
a  D 

(14)  and  the  interval  where  the  sought  signal  x  is  supported. 

If  the  solution  to  (16)  exists  and  is  unique,  this  analysis  shows  that 
the  portion  Ty  of  the  data  y  will  be  enough  to  recover  x.  However,  as  was 
pointed  out  in  Section  I,  this  will  not  be  the  case  if  some  noise  is  present 
in  the  given  data  y.  In  that  case,  there  is  no  £  priori  reason  to  believe 
that  the  portion  y(n),  n  e  "best"  choice  for  applying  any 

restoration  algorithm. 

There  are  many  alternatives  for  dealing  with  this  problem.  The  first 
natural  attempt  is  to  try  to  "shift"  the  data.  Unfortunately,  if  one  has 
in  mind  the  restoration  algorithm  (15) ,  this  operation  will  Introduce  changes 
in  the  distortion  operator.  This  might  make  those  conditions  on  the  distortion 
H  which  are  needed  for  insuring  convergence  of  (15)  impossible. 
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Another  alternative  is  to  "enlarge"  the  interval  of  time  where  the  original 
signal  X  is  to  be  sought.  This  means  that  it  might  be  possible  to  apply  (15) 
for  defined  as 

1z(n),  n  e  t 

0  otherwise 

where  [n  ,n,  ]  C.  [n',n'].  In  this  case,  one  needs  to  study  how  the  part  of 
a  D  —  a  D 

the  restored  signal  which  leaks  out  of  [n^,n^]  depends  on  the  noise  in  the 

data.  Another  related  alternative  is  to  use  some  constraint  which  Incorpor- 

Ic  Ic 

ates  into  the  restoration  scheme  (15)  the  information  contained  in  T^x  -  Tx  , 

for  every  k.  For  example,  if-  D  is  not  a  point-by-point  operator,  it  will  not 

commute  with  T,  that  is  to  say  DT  ID.  In  this  case,  D  might  do  the  desired 

job  if  we  Implement  equation  (15)  by  means  of  ID  Instead  of  DT.  This  also 

shows  the  importance  of  combining  the  constraints  properly  in  the  iterative 

procedure  even  though  DTx  «  TDx  when  x  is  the  sought  solution  to  the  problem  (16) 

Another  technique  was  given  in  [1].  It  consists  of  low-passing  the  data 

y  before  applying  any  restoration  technique.  This  process  produces  a  signal 

y  >  h'*y.  In  this  case,  this  operation  merges  the  data  y  according  to  the 

nature  of  the  noise  and  therefore,  the  w'indow  y(n) ,  n  e  [n  ,n,  ]  should  contain 

a  D 

more  information  about  y  than  y(n),  n  e  [n^,n^] .  However,  in  applying  iteration 

(15)  (with  y  as  data  and  h'*H  as  the  distortion  operator)  it  seems  hard  to 

explain  why  y(n) ,  n  e  [n  ,n.  ]  is  the  best  part  from  y  which  can  be  used  in 

a  0 


the  restoration. 
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Appendix  I 


To  prove  Theores  1  we  will  need  to  prove  the  following  lennnas: 
Leama  1 


Let  S  »  Cx(n),  n  <  n  ^  n^^:  £  x'^Cn)  •  l},  and  let  A  be  any  axibset  of 
*  n-na 

[-TT,n]  such  that  [-rr,n]-A  is  a  set  of  non-zero  measure.  :nien,  there  exists  a 
constant  c<l,  such  that: 


Proof 


It  Is  clear  that 


*  I-TT 


(AI.l) 


A 

Nevertheless,  since  [-n,TT]-A  Is  a  set  of  non-zero  measure,  and  x((u)  « 
nb 

£  x(n)»e  cannot  vanish  over  (-rr,TT]-A  (because  t-TT,n]-A  Is  an  Infinite  set) 
n*na 

then  strict  inequality  must  hold  In  (Al).  Taking  Into  account  that  x€  S,  we  have: 


< 


1  . 


(AI.2) 


But  the  left-hand  term  in  (AI.2)  Is  a  continuous  real  valued  fxinctlon  of  x,  defined 
on  the  compact  set  S,  then  we  may  write 


xc  S 

(3)  proves  the  lemma. 

An  Immediate  corollary  Is 
Lemma  2 

Using  the  same  notation  as  In  Lemma  1, 


c  <  1  . 


(AI.3) 


there  Is  a  constant  C  <  1  such  that 
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t 


f 


I 


Juj€  a|  x((u  )|  ^dt»)  <  c  II  x||^, 

for  all  sequences  x:  x(n)  »  0  if  n$  [n^,n|j]. 

Comnents 

1.  Let  us  suppose  that  A  Is  also  of  positive  measure.  It  is  worth  saying  that 
using  the  same  idea  as  in  Lemma  1,  it  may  be  shown  that  there  exists  another 
constant,  say  d,  d>0  such  that 

for  all  x;  x(n)  »  0  if  n?  [n^,njj]. 

2.  The  constant  C  in  Lenmia  2  as  well  as  d  depends  on  only  the  set  a  and 

the  time  interval  [n  ,n.]  under  consideration. 

a  D 

Theorem  1  (proof) 

11(8  -\h)*Txf  =  |l(l-\h)Tx||^  -  |l-\h  (U))|2|Tx|^d«« 

Taking  into  account  properties  (a)  and  (b)  of  Theorem  1: 

||(8-Xh)*Tx||2  ^  ^  J’^^j,)^x(u))|2du,  +  J^x(u;)  |2dm 

"  INI^  ■  Juje 

then,  we  have 

II  (8  -Xh)  *Tx||^  S  K^ilTxjl^  +  (1-K^)  J^g^l  Tx  (UJ)  l^dtu, 
and  using  Lemma  2 : 
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11  (5  h  )  *Txil^  ^  [K^  +  (  1  -  )  C  ]  1!tx 

where  C  <  1.  If  we  denote 

M  -  +  (X-K?)  C]^ 

and  realize  that  Me  1,  we  have  completed  the  proof. 


Theorem  3  (proof) 

We  will  give  only  the  proof  for  the  condition  II.  We, want  to  find 
I  1-X  H(u))|  ^  =  1-2X  ReH(aj)  + 1  H  (ui  )  (  ^ X  ^  S  1 
Under  the  conditions  stated  by  II,  we  get  the  inequality: 

-2XH(uj)  +  H^(uj)X^  i  0,  for  all  o)€  (-Tr,TT)  . 


When  H(uj)  =0,  (AI.4)  becomes  automatically  true;  when  this  is  not  the  case 
we  must  choose  X : 


0  <  X  i  2  ,  for  all  (ju€  [-7T,tt]  . 

H  (03) 


This  yields  to  the  condition: 


^  ^  ^  ^  irar  *  * 

U3€  [.T7,^] 


When  03 5  S,  we  need  X  to  be  such  that: 


(AI.4) 


(AI.5) 


1-X  H(aj)|  i  K  <  1. 


1.23 


B 


2  2  2 

Let  us  put  (1-C  )-2\  H(tju)  +  X  H  ((o)  ^  0,  u)€  S,  C  >  0  for  some  \  and  C  to  be 
chosen. 

In  making  such  a  choice  \  must  satisfy: 


1"C  1“C 

since  u)6  S,  then  ""jj”  >  this  Implies  that  C  should  be  such  that; 


1  - 


M 


1  >  c  a  — H  ^  >  0 


(AI.6) 


1  “  C  1+C 

In  order  that  X  can  exist.  X  should  belong  to  (  ,  y )  which  is  non-empty 

because  of  (AI. 6),  Finally X  must  also  satisfy  (AI.5);  by  ge'tting  both  conditions 
together,  we  have 


(AI.7) 


Since  C  is  positive  and  less  than  1,  (AI.7)  is  equivalent  to  X€ 

M  M 


r 

c 
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Appendix  II 


We  present  here  an  extension  of  Theorem  1  to  the  case  where  H  is  a 
shift-variant  linear  operator.  The  constraint  involved  is  TP  where  T  is  the 
truncation  operator  and  P  is  the  following  positive  operator: 


(Px) (n) 


x(n),  if  x(n)  ^  0 
0  otherwise 


Theorem 


Let  h:h(m,n). 

-'»<n<  +  *  ,  be  a 

sequence  such  that: 

+  09 

(a') 

Z  h(m,n)  •  h(m,n)  <  +  », 

for  all  n,n:  n.  s  n,n 

S 

tQS^  OB 

(b') 

h(m,n)  ^  0,  for  all  m,n  . 

(c') 

h(m,n)  >  0,  for  n,m:  n_  s  n 

cL 

VI 

a 

Then,  there  exist  some  constants  X,  and  C  <  1,  such  that: 

11  (I-X  h  )  PTx  11  sc  11  PTx  11 
for  all  sequences  x  :x(n),  -«<n<+=  .  * 


Proof 


We  will  start  bv  cissumiag  that  '!  T?::"  =  1.  Let  ua  call  y  =  ?: 


ii  (I-Xh)TPx;!^  -  Z  |Ty(ra)-\  h(m,n)y(n)|^ 

m»-«  n«n_ 


(All. L) 


where  \  is  to  be  chosen  properly.  (AII.l)  becomes: 

^  2  ->  %  7- 

-  (  (Ty  (m) )  -l\Ty(m)*  Z  h(m,n)y  (n) +X“  (  Z  h  (m,n  )y  (n) 
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nb  Ufa  2  “b  2 

»  l-2\  n  y(in)»  S  h (ni,n)y (a) +X  •  E  (S  h(in,n)y(n))  , 
n«ia  n=na  m—oa  n=n^ 


Using  the  property  (a*)  of  h  we  get 


-H»  nb  2  ”b  “b 

>  S  (2  h(m,n)y(n))  »  2  2  (2  h(m,n)h(in,n))y  (n)y  (S) 

m»-«  n=na  ®“”** 

Now,  we  have  the  function  ^  :  2  i|  (I-X  h)2||  defined  over  the  set 


S'  «  {z:2  (n),  :  ||zll  »  1,  z  ^  O}  which  is  a  compact  set.  Taking  into 
account  that  is  real-valued  (and  finite.')  and  continuous,  attains  its 
maximum  value  over  S ' : 


max  Yj^(z)  =  Cj^  ■  (All. 2) 

z6  S' 


We  want  X  to  be  a  real  number  (and  positive)  such  that  C,  <1  .  But  (All. 2)  says 


that  it  will  be  enough  to  find  \  : 


(z)  <  1,  for  all  z6  s  '  . 


So,  we  want  to  choose  X  such  that 


tti.  n.  2  ®b  2 

■2X  2  2  h(m,n)y (m)y (n)  +X  2  (2  h(m,n)y(n))  <  0  (All. 3) 

m»n  n=n_  ma-oa  n*n_ 

A  A  a 


for  all  y:y(n),  n  «  n,  s  n  :.y€  S'  . 

abb 


By  properties  (b ' )  and  (c ' )  we  know 


I  H  fy 

2  (2**  h(m,n)y''n))  is  non-zero 

m*-<9  n»n 

a 


for  all  yes'. 


Then,  getting  (A6)ls  equivalent  to  choosing  X: 


0<X  < 


^  mi.  ni.  l>(«.n)y(m)y(n) 
nb  nb  +* 

Z  Z  '{Z  h(m,n)h(iii,n)} 
n=»na  fi*na  ni=-oB 


y  (n)y  (n) 


(All. 4) 


for  all  yes'. 


The  condition  (All. 4)  is  realized  when  we  choose  X  >  0: 


X  •  Z  h(m,n)  •  h(m,n)  <  2h(n,n),  for  all  n^  ^  n,nSnj^ 


(ATI. 5) 


Such  a  number  X  exists  since  h(n,n)  >  0,  n  S  n,n  S  a  ,  and  since  (ATI. 5)  must  b 

a  b 

satisfied  for  a  finite  set  of  indices  only.  The  fact  that  (All. 5)  implies  (ATI. 4) 
seen  by  using  the  positiveness  of  y(n),  n  ^  n  s  n.  ,  and  by  observing  that 
y  is  not  identically  zero.  Now  it  is  easy  to  see  that  the  same  X  can  be 
to  assure  jj  (I  - X  h  )TPxjj^  a:  c  C<1  when  llTPxjj^  1. 


1.27 


Acknow ledgement 

The  work  of  Jorge  L.  C.  Sanz  was  supported  by  Consejo  Nacional  de 

Investlgaclones  Clentificas  y  Tecnlcas  of  Argentina. 

Thomas  S.  Huang  was  supported  by  the  Joint  Services  Electronics  Program 

xmder  Contract  No.  N00014-79-C-0424. 

Re-ferences 

[1]  R.W.  Schafer,  R.M.  Mersereau  and  M.A.  Richards,  "Constrained  Iterative 
Restoration  Algorithms,"  Proc .  IEEE .  Vol.  69,  pp.  432-450,  April  1981. 

[2]  V.T.  Tom,  T.F.  Quatieri,  M.H.  Hayes  and  J.H.  McClellan,  "Convergence  of 
Iterative  Nonexpansive  Signal  Reconstruction  Algorithms,"  IEEE  Trans. 
Acoust.,  Speech  and  Signal  processing.  Vol.  ASSP-29,  No.  5,  pp.  1052- 
1058,  October  1981. 

[3]  D.  Toula',  "Generalized  Image  Restoration  by  the  Method  of  Alternating 
Orthogonal  Projections,"  IEEE  Trans.  Circuits  Systems.  Vol.  CAS -2 5,  No.  9, 
September  1978, 

[4]  J.  L.  C.  Sanz  and  T.  S.  Huang,  "Discrete  and  Continuous  Band-Limited 
Signal  Extrapolation,"  submitted  to  ASSP,  1982. 

[5]  A.  K.  Jain  and  S.  Ranganath,  "Extrapolation  Algorithms  for  Discrete 
Signals  with  Application  in  Spectral  Estimation,"  IEEE  Trans.  Acoust., 
Speech  and  Signal  Processing,  Vol.  ASSP-29,  No.  4,  pp.  830-345, 

April  1981. 


Discrete  and  Continuous 


Band-Limited  Signal  Extrapolation 


Jorge  L.C.  Sanz 
Thomas  S.  Huang 

Coordinated  Science  Laboratory 
University  of  Illinois  at  Urbana-Champalgn 
1101  W.  Springfield  Avenue 
Urbane*  Illinois  61801 


ABSTRACT 


This  paper  has  tvo  main  purposes.  First,  some  new  algorithms  for  the 
extrapolation  of  multidimensional  band-limited  sequences  are  presented.  These 
algorithms  extend  those  given  In  [1]  In  two  ways:  (1)  We  do  not  Impose  any 
restrictions  on  either  the  shape  of  the  region  containing  the  set  of  samples 
of  the  2-dlmenslonal  signal  to  be  extrapolated  or  the  shape  of  Its  pass-band 
zone.  (2)  We  obtain  a  class  of  sequences  which  are  band-limited  extrapolations 
of  the  given  data  (Including  the  minimum  norm  solution  of  [1]  as  a  special  case) 
This  Is  useful  when  some  aprlorl  Information  about  the  signal  to  be  extrapo¬ 
lated  Is  available.  The  second  objective  of  our  paper  Is  to  relate  the  dis¬ 
crete  extrapolation  problem  to  the  continuous  signal  extrapolation  problem  [2]. 
Specifically,  we  prove  chat  the  solution  obtained  by  using  our  approach  for 
Che  discrete  extrapolation  problem  tends  to  the  solution  of  the  continuous 
problem  when  Che  sampling  race  used  In  the  known  part  of  the  continuous  signal 
to  be  extrapolated  approaches  Infinity. 


I. 


INTRODUCTION 


Let  us  begin  by  recalling  what  is  meant  by  continuous  signal  extra- 

A 

polatlon  and  discrete  signal  extrapolation.  Let  f:  S  — be  a  multi¬ 
dimensional  signal  of  finite  energy. 


and  let  f  be  band-limited  to  some  set  ^1, 


f(io)  -  0  if 


where  f  denotes  the  continuous  Fourier  transform  of  f.  Now,  If  we  are  given 

a  piece  of  f  only,  (l.e.:  we  know  the  function  g:  Ci  — »  C  :  g(x)  «  f(x),  x€^  ) 

c  c 

then  the  contlnous  extrapolation  problem  Is 


To  find  f  J  R*'  — »  C  such  that 

I)  f  Is  band-limited  to  . 

II)  f(x)  -  g(x)  for 

It  Is  well  known  that  f  Is  uniquely  determined  because  f  Is  an  analytic 

function  (We  assume  that  (X  contains,  at  least,  an  open  set).  Several  authors 

c 

have  addressed  this  problem  and  some  algorithms  were  given  ([2] , [3] , [4] ,  among 
others).  The  technique  suggested  In  [2]  Involved  the  computation  of  the  so-called 
prolate  spheroidal  wavef unctions.  These  functions  were  shown  to  be  very  use¬ 

ful  In  understanding  the  extrapolation  problem,  as  well  as  In  proving  the  conver¬ 
gence  of  the  Iterative  algorithm  given  In  [3].  Ref.  [4]  presented  an  Iterative 


II. 3 


procedure  which  is  essentially  equivalent  to  that  of  [3]  but  its  convergence 
was  proven  without  the  use  of  the  prolate  functions.  This  equivalency  was 
shown  in  [5].  In  the  same  paper  [4],  another  procedure  was  given  which  re¬ 
quires  the  solution  of  the  Integral  equation: 

^  ^  sln<^  (x-t)  .2(t)dt  -  f(x),  x6iZ  (3) 

where  slncQ^  Is  the  operator  whose  Fourier  transform  Is 


x^(UJ)  - 


(4) 


This  approach  has  one  main  disadvantage:  the  integral  equation  (3)  may  not  have 
a  solution. 

There  does  not  exist  any  reason  to  restrict  our  attention  to  the  sincQ 
kernel  only,  since  any  other  kernel,  say  h^^,  band-limited  toil,  leads  us  to  a 
new  approach  by  solving  the  Integral  equation: 

Jq  l»^(x-t)z(t)dt  -  f(x),  (5) 

provided  that  z(t)  exists. 

When  any  of  these  algorithms  are  applied  numerically,  some  approximations 
are  necessary,  such  as  sampling  functions,  quadrature  formulas  for  Integrals, 
replacing  Infinite  domains  by  finite  ones,  etc.  As  It  was  pointed  out  In  [1],  and 
as  far  as  we  know,  no  relationships  were  established  between  the  approximations 
and  the  real  solution  to  the  problem. 


II. 4 


To  relate  the  continuous  extrapolation  problem  with  the  discrete  one. 
It  might  be  useful  to  consider  the  Iterative  procedure  ([4]): 


'o-“ 


f^l(x)  -  +  slnc^*  (g-Tf^)(x), 


(6] 


where  g(x)  *  f(x).  If  and  0  elsewhere,  T  denotes  the  tlme-llmltlng 

operation: 


Tf  (x) 


f(x),  x£Q^ 
0,  elsewhere 


(7) 


and  *  denotes  convolution. 

Now,  If  A  Is  any  positive  real  number,  one  possible  sampled  version 
of  (6)  Is: 


y„(x^)  -  0 


where  Xj  “  jA  ,  set  of  Integer  numbers). 

It  Is  well  known  that  the  sequence  of  functions  f^  defined  by  (6), 
constitutes  a  family  of  band-limited  functions  which  converges  to  f  In  the 
energy  norm,  l.e.: 


(8) 


f  -  f 
n 


0,  when  n  — >  , 


and,  therefore,  f  approaches  f  In  the  maximum  norm,  l.e. 
n 


max 

X 


'n  -  Ml 


0,  when  n 


OO  . 


f^(x)  -  f(x)| 


Nevertheless,  there  is  no  aprlorl  reason  to  believe  that  the  family  of  sequences 
defined  In  (8)  converges.  This  problem  was  solved  In  [1],  for  *  1;  It  was  shown 
that  y^  converges  to  a  sequence  y  In  the  energy  norm,  l.e.: 


In  addition.  It  was  proven  In  [1]  that  the  limit  y  Is  one  solution  to  the 
discrete  extrapolation  problem; 


Given 


a  set  of  discrete  samples,  find  a  sequence 


2(k),  k62Z”,  such  that: 


1.  2(k)  ■  g(k),  k&^ 

2.  2  Is  band-limited  to  ill,  l.e.: 

F(2)(UJ)  -  Zi  „  2(k).e^*'‘*^  -  0,  when  UJ^nc[-7r,ir 

k€2 "  .  (10) 

(F(z)  will  denote  the  Fourier  series  of  the  sequence  2) 

Since  the  discrete  extrapolation  problem  does  not  have  a  unique  solu¬ 
tion,  It  was  also  shown  In  [1]  that  the  sequence  y  of  (9)  has  the  minimum- 
norm  property  among  those  which  satisfy  1.  and  2.  Due  to  this  simple  charac¬ 
terisation  of  y,  many  other  algorithms  may  be  chosen  to  compute  It.  Nevertheless, 
[1]  did  not  discuss  the  relationship  between  y  and  the  contlnous  extrapolation 
problem. 

Taking  Into  account  that  the  discrete  extrapolation  problem  has  Infinite 
many  solutions,  we  think  there  Is  no  reason  to  believe  that  the  minimum-norm 
extrapolation  y  Is  the  only  useful  sequence  to  approximate  the  solution  of  the 
continuous  problem.  In  this  paper,  we  will  show  that.  In  fact,  there  exist 
many  other  criteria  to  pick  up  solutions  to  the  discrete  extrapolation  problem 


\ 
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which  yield  approximations  of  the  continuous  problem.  All  the  results  are  valid 
for  iBultl-dimenslonal  signals.  Since  we  do  not  need  any  restriction  on  the 
sets  ^  and  ,  our  results  extend  those  discrete  techniques  presented  In  [1] 
to  2-dlmenslonal  signals.  We  also  present  some  Iterative  techniques,  which 
generalize  that  of  (8),  which  are  shown  to  be  convergent  by  using  the  results 
obtained  In  a  recent  paper  ([6]).  The  connection  between  the  discrete  and  con¬ 


tinuous  extrapolation  problems  will  be  made  by  means  of  a  rather  general 
theorem  on  Interpolation  by  means  of  band-limited  functions.  This  theorem 
Indicates  that  many  other  technlqties  might  be  Investigated  In  order  to  get 
approximations  of  the  continuous  extrapolation  problem.  In  connection  with 
the  new  algorithms  presented  here,  we  also  Include  some  numerical  examples. 


II.  7 


MAIN  RESULTS 


In  this  section  we  present  our  main  results.  Section  II. 1  Is  devoted 
to  new  techniques  for  the  discrete  extrapolation  problem.  Section  II. 2  Is 
mainly  concerned  with  the  connection  between  the  discrete  and  the  continuous 
problems . 

II.  1  Let  z:  z(n))  n£Q  be  a  finite  sequence.  We  want  to  extrapolate  z 

to  a  band-limited  sequence.  One  possible  technique  to  do  such  extrapolation  is 
as  follows:  Let  h:  h(m),  m  be  a  band-limited  sequence.  Then,  If  we 

define  y  >  h  *  x,  where  x  Is  any  sequence,  we  will  get  another  band-limited 
sequence  y.  Now,  If  we  could  find  an  x  which  makes  y(n)  ■  2(n),  ,  then 

we  would  get  one  possible  band-limited  extrapolation  of  z>  The  next  theorem 
states  this  result: 


Theorem  1 

Let  iTi  be  any  non-zero  measure  subset  of  [-‘TT  ,Tr  and  ^  be 
any  finite  subset  of  Z"  .  Let  h:  [-IT  ,"0*]  — >  R  be  a  non-negative,  bounded 
function,  which  satisfies  h(LU)  •  0,  U3  .  Let  z(n),  n  ea  be  a  set 
of  observations.  Then,  If  we  define  y  *  h  *  x,  where  h  Is  the  sequence: 


h(n)  ■  h(uJ)e 


and  X  Is  a  sequence  which  satisfies: 


11.8 


x(m)  •  0  i.t  Cl. 

z(n)  ■  IS  h(n-m)x(m),  neQ 

m€Cl 

Then:  y  Is  an  extrapolation  of  zr,  band-limited  to 


Moreover,  the 


sequence  x  Is.  the  solution  of  the  following  optimization  problem: 


minimize 


A 

h(uJ) 


S  ^_s(k)e^ 


subject  to 


k€z;“ 


(k)l  < 


f  h(LLJ)(  S  3(k)e*^^®"^^‘*^  du>  .  n6(2 

Ja  ke'a" 


(13a) 


(13b) 


(13c) 


It  Is  convenient  to  remark  that  the  matrix  H:  h(n-m),  n,m  ^Ci  (14) 

Is  positive-definite;  (see  the  appendix  for  a  proof)  In  particular,  this  assures 
that  the  sequence  x,  defined  by  equation  (12),  exists. 

It  is  worth  pointing  out  the  following  property: 


Corollary  1 


f.  A. 

If  z(n),  n€u  Is  real,  and  if  h(uJ)  «  h(-uJ)  for  all  UJ ,  then  extra* 
polatlon  y  given  by  theorem  1  Is  also  real. 

Now,  we  connect  the  result  stated  In  Theorem  1  with  those  of  [1]. 


IL9 


Corollary  2 


Under  the  same  conditions  of  Theorem  1,  if  in  addition  h  has  the 


following  properties: 


(i)  h(uJ)  0  UU€.in 

(ii)  The  function  k(u:)  defined  as  follows: 


k(uJ) 


0,  if  UJ 


— ,  if  UJ  e  in 

h(uJ) 


has  finite  energy: 


A  j2 

k(uJ)  duJ  <  CO 


[-T.ir]’ 


then,  the  sequence  y  given  in  (11)  is  the  solution  of  the  following  optimization 
problem:  Find  s(k), 


minimize 


^(LU)  I  F(s)  |(UJ)  djj 


subject  to: 
s(m)  -  z(m),  m  ^  Ci 


(16a) 


F(s)  is  bounded  in  [-T,  Tfl 
s  is  band-limited  to^- 


(16b) 

(16c) 


Corollary  3 


If  h  satisfies 

fi,  UJ  en 


h(ui)  • 


0,  otherwise 


then,  the  extrapolated  sequence  y  Is  the  minimum-norm  solution  o£  the  discrete 
extrapolation  problem,  where  z(m),  m^CL  Is  the  Initial  data. 


Since  the  matrix  H  defined  In  (14)  is  positive-definite, well  known. 

algorithms  may  be  applied  to  solve  the  system  of  equations  (12).  In  the  1- 

dlmenslonal  case.  If  h(w)  «  h(-w),lUG  [''H'  ,ir]  ,  then  H  Is  symmetric  and 

since  H  Is  Toeplltz,  the  Levinson's  algorithm  can  be  applied.  For  the  multl- 

A 

dimensional  case,  more  conditions  related  to  the  symmetry  of  h  are  necessary  to 
assure  H  to  be  block  Toeplltz. 

Anyway,  In  the  1-dimenslonal  case,  as  well  as  In  the  multidimensional 
case,  we  have  an  Iterative  algorithm  to  compute  x(m),  m  ^  6^  ,  and  therefore, 
to  compute  y(m) ,  m  ^  .  -This  algorithm  yields  some  generalizations  of 

the  Interatlve  approach  (8). 


Theorem  2 


Under  the  same  conditions  as  In  Theorem  1,  let  \  be  any  real 
number  such  that: 


(a) 

(b) 


1  -  Xh(uJ) 


1  -  A.h(UJ) 


41,  for  all  uje  [-Tr,’rr]“. 

4K  ^1,  for  some  K  and  for  all  uj€0. . 


Then,  the  sequence  x^(m),  mE.Q.  ,  k^^  ,  k  ^  0,  given  by  the  formulas: 


x^(m)  "  any  Initial  guess. 

x^^^(m)  -  x^(m)  +  X(z(m)  -  2  h(m-n)x^(n))  (18) 

nea 

It 

converges  to  the  solution  of  equation  (12).  Moreover,  the  sequence  y  (m), 
k^^  ,  k  ^  0  ,  given  by 


(19) 


y  any  initial  guess  band'-llmlted  to 

y^^(m)  -  y'^(m)  +  \  ^Z»  (z(n)  -  y'^(n))h(m-n) 

n^Ot- 


converges  to  the  extrapolatloh  y,  given  in  Theorem  1,  in  the  energy  norm,  l.e. 


y^  -  y  j|  - ^  0,  k - ^ 


It  is  clear  that  (19)  becomes  (8)  when  the  dimension  n  is  1,  ^  ~  1  and 
h(m)  ■  slnc^(m),  m^2S. 

The  recursive  formula  (19)  is  well  knotm.  The  interesting  point  is 
about  the  way  'K  was  chosen.  We  have  a  set  of  admislble  values  for  X  which 

A  ^ 

depends  on  h  only.  This  means  that  any  ^  in  this  set  is  useful  to  make  the 
iteration  (19)  converges,  no  matter  what  Q.  is  considered.  In  other  words, 
^  does  not  depend  on  the  size  of  the  matrix  H.  The  conditions  Imposed  ’on  h, 
l.e.:  boundnes  and  non-negativity,  assure  that  the  set  of  possible  values  of 
X.  is  non-empty  (see  [6]). 

To  end  this  section,  we  would  like  to  point  out  that  equation  (12) 
might  be  understood  as  a  sampled  version  of  the  Integral  equation 


(s-t)x(t)dt 


f(s),  s^Q.^ 


(20) 


where  z(n)  •  f(nf^)  and  where  the  integral  is  to  be  replaced  by 
A  2  h(^[  (m-n)  A]x(n^) 

nca 

Nevertheless,  we  think  that  this  approach  should  be  avoided  since  (20)  might 
not  have  any  solution.  Even  if  this  was  not  the  case,  the  sampled  approximation 


11.12 


would  be  a  non-reliable  technique  to  approach  the  solution  x(t),  though 

(21)  has  always  a  unique  solution:  x^(n),  ■a&Ci,  there  Is  no  evidence  Chat  (n) 
approaches  x(t)  when  A  tends  to  zero.  On  the  other  hand,  we  are  Interested 
In  getting  a  good  approximation  of  £  beyond  and  not  In  determining  an 

approximation  of  x(c),  tea  • 


II. 2  In  this  section  we  discuss  the  connection  between  the  discrete  and  the 
continuous  extrapolation  problems.  We  begin  by  stating  the  main  result: 

Theorem  3 


Let  f  be  band-limited  to  .O.  .  Let  S.  :  *2,  k  ^  0  be  a  family 


of  subsets  of  S.  such  that: 


(1)  Mesh  (S,  )  sup  I 


Inf 

yes, 

T^z 


i  [  ]  tends  monotonlcally  to  zero. 


■I 


II)  ,  for  all  k. 

III)  XJ  S.  Is  dense  In  a  certain  open  subset  of  • 

Let  k^  0  *  sequence  of  -band-limited  functions: 


a)  fj^(3c) 


b) 


£(x),  for  all  x£S 
^  C  ,  for  all  k. 


k  • 


Then,  there  exists  a  subsequence  f  which  converges  Co  f  uniformly  over  compact 
sets  In  E.  ,  l.e.:  for  each  K  S  e”  compact  and  given  £  >  0  ,  there  exists 


koez 


k„  >  0 


such  Chat 


sup 

x€K 


for  all  k  ^  kjj. 


We  would  like  to  point  out  that  Theorem  3  may  be  understood  as  an 
Interpolation  theorem  where  each  f Is  a  i'-  -band-limited  Interpolation  of 
Che  data  f(x),  x^  S^.  Property  b)  states  that  the  energy  of  f^^  must  be 


bounded  by  some  constant  C,  which  is  Independent  of  k.  Then,  given  any 
compact  set  K,  any  Interpolation  Is  close  to  f  over  K  when  k  ^  k. 
Nevertheless,  since  Is  a  subsequence  of  fj^,  the  theorem  does  not  assure 

in  principle,  that  f^  will  be  close  to  f  over  K  for  all  h  ^  "k^* 

Now,  we  give  a  complementary  result  which  will  be  useful: 

Theorem  4 

Under  the  same  conditions  and  notations  as  In  Theorem  3,  let  us 
suppose  that  the  constant  C  can  be  chosen  as  H^ll  2  • 

ll^kll^^  11^11^.  for  all  keZ,  k>  0. 

Then,  the  subsequence  fQ^^  converges  to  f  uniformly  over  the  whole  space 

Now  we  will  apply  these  results  to  relate  the  continuous  and  the 

A 

discrete  extrapolation  problems:  Let  us  suppose  that  h:  K  — >  K  Is  non- 
negative,  bounded  and  h(w)  »  0,  w  40..  We  assume  h(w)  0,  w  ^  •  We 

are  given  f(x),  x  »  where  f  Is  -band-limited  with  finite  energy 

We  assume  that  f  and  h  satisfy  the  following  relationship: 


^  has  finite  energy  in 


r 

)n 

h(a» 

du)  < 


Now,  let  be  a  sequence  of  positive  numbers  such  that: 

1)  T^  tends  monotonies lly  to  zero. 


ii)  ~  >  ||n  II  -  sup^(|x|j ,  X 


r,  for  all  k. 


and  let  us  consider  the  following  sample  sets  S.  Q  Qj- 


The  family  ^  satisfy  all  the  conditions  stated  in  1),  li)  and  ill)  of 

Theorem  3.  Now,  for  each  k  we  take  samples  of  f  over  S^:  Z^^(n)  -  f(nT^),  nT^ 
Sflg  and  we  look  for  a  discrete  extrapolation  of  Z.jj^(n),  n€Clx|j  " 
band-limited  to  Tj^*^  ■  ^Tj^.xixfilT^.  We  know  that  we  need  a  criterion  to  pick 
up  one  extrapolation.  Let  us  suppose  that  we  follow  the  technique  given  in 
Theorem  1: 

YTjjC®)  ■  (^Tit*  *T^)(®)»  (22') 

where  F (^Tv)  (w  )  »  h(~) , 

k  . 

We  recall  that 


h(s) 


-TL 

Then,  the  function 


j  h<u.). 


-ittls  ,  «  n 

e  duJ,  s  €11  . 


fk(s)  -  (V".  XI  h(s-mTj^)xxj^(ii)  a  e  » “ 

m€Cl.X|t 


(23) 


is  band-limited  to  n  ;  in  addition^  since  hxjj(n-m)  «  (Tj^)*^.h(Tj^(n-m)) ,  we 
also  have  fj^(mTj^)  ■  yxj^(®)»  for  all  m  and,  in  particular,  fjj(x)  •  f(3c)»  when 
jte  . 

Theorem  1  and  the  relationship  between  f  and  h  given  by  formula  (22) 
yield  to  the  following  theorem  (for  a  detailed  proof,  see  the  Appendix). 


Theorem  5 

There  exists  a  constant  C  such  that 

il'kllj^  C.for.Ulc. 
where  f^  is  given  by  formula  (23). 

It  is  worth  pointing  out  that  the  function  given  in  (23)  is 

the  natural  Interpolation  of  yxj^(®) »  n  €  means  of  a  .O.  -band-limited 


vavefcrm.  In  fact  (23)  Is  exactly  the  same  as  (22')  replacing  the  discrete 
variable  m  by  the  continuous  one  S  (properly  scaled) . 

Now,  taking  Into  account  Theorem  5,  the  other  properties  of  f^  and 
Theorem  3,  we  obtain  the  following  result: 

Theorem  6 


There  exists  a  subsequence  of  T^:  Tq^  — >  0  such  that  fQ^  approaches 
f  uniformly  over  any  compact  set  In  £ 

Note  that  when  h  Is  the  Indicator  function  of  jQ.  (17) ,  property  (22) 


holds,  since  f  has  finite  energy.  In  this  particular  case.  It  will  be  shown 
In  the  Appendix  that  the  constant  C  In  Theorem  5  can  be  chosen  equal  to  ||f  1^2 
Therefore,  Theorem  4  applies  and  we  have  a  subsequence  which  converges  uni¬ 
formly  over  to  f.  In  addition.  It  can  be  proved  that|fj^||2~>^j  f||  2  »  wher 

the  limit  Is  taken  over  the  whole  sequence  and  not  only  for  n^. 


Two  questions  remain  unanswered.  The  first  one  Is  related  to  the 


convergence  of  f^  to  f  where  k  Is  any  Index,  when  h  Is  the  Indicator  of 


a . 


The  other  question  Is  about  the  convergence  of  f^^  to  f  over  the  entire  b" 

A 

when  h  Is  an  arbitrary  function  which  satisfies  the  properties  discussed  above 


l.e.:  bounded,  positive  and  (22). 


Ill 


NUMERICAL  EXAMPLES 


The  purpose  of  this  section  Is  to  present  some  numerical  exaiiq>les 
related  to  the  new  extrapolation  techniques  given  In  Section  II. 1.  We  will 
solve  the  extrapolation  problem  following  the  Ideas  given  In  Theorem  1, 

Section  II. 1.  We  are  given  f:[-l«l]  — >  K  which  Is  a  piece  of  a  band-limited 
function  (here^i  *  1^)) .  The  frequency  response  of  the  kernel  h,  which 

were  used  are  plotted  In  Figures  1,  2  and  3.  They  will  be  called  h^*  h^  and 
h^,  respectively.  The  data  f  will  be  a  piece  of  h^,  h^  or  h^  sampled  on 
[-1*1]  using  T  "  -g-.  All  the  extrapolations  to  be  considered  are 

on  [-3,3]  and  they  are  sampled  using  the  same  T  as  In  the  known  interval  [-1,1]. 

We  use  two  approaches.  In  the  first  approach,  we  solve  the  system 
of  equations. 

Z  -  H*  (12) 

by  means  of  the  computer  algorithm  given  In  [11].  We  recall  that  H  is  given 

by  the  formula  H  -  T.h.  r(m-n)Tl  and  Z:  Z  ■  h . (nT)  where  h.  and  h.  are 
m,n  1  L  J  o  .1  1  j 

the  filter  and  the  data  to  be  used.  The  extrapolation  is  given  by  y  *  h  *  x. 

Tables  1,  2  and  3  summarize  the  results  obtained  with  this  approach. 

In  the  first  case  (Table  1),  we  use  h^  and  the  data,  sampled  with  *  'g’  (see(a)) 
and  h^  as  the  filter  (see  (b)).  The  result  Is  much  better  than  that  obtained 
with  h2  as  the  filter  (c) .  Nevertheless,  It  Is  clear  that  the  last  combination 
(l.e.  h^  data  and  h2  filter)  does  not  satisfy  the  relationship  (22).  Also 
Included  was  the  solution  of  the  system  of  equations  (12)  (see  (d)).  It  Is 
seen  that  (d)  Is  far  from  the  real  solution  of  (12).  That  shows  that  the 
technique  may  not  be  reliable.  Nevertheless,  It  Is  also  seen  that  the  extrap¬ 
olation  Is  of  acceptable  quality  beyond  (-1,1).  The  phenomenon,  which  was 
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also  observed  in  the  other  numerical  examples  given  below,  has  not  been  fully 
explained  yet.  Although  the  solution  Xq  given  by  the  algorithm  [11]  Is  far 
from  the  actual  solution,  the  extrapolated  values  on  [~1,1]  are  close  to  thb 
real  samples.  This  effect  may  be  explained  as  a  consequence  of  the  ill-condi¬ 
tioned  nature  of  the  matrix  H.  We  think  that  for  the  examples  considered  here 
small  errors  Inside  [-1,1]  (l.e. :  Hx^  -z  l\  small)  assure  the  extrapolation 
to  be  close  to  the  real  waveform  on  the  sample  points  In  [-3,3]. 

In  the  second  case  (Table  2)  we  used  h2  as  the  data,  (a)  Is  the  list 
of  samples  on  [-3,3]  with  T  ■  — ^  (of  course,  only  the  points  in  [-1,1]  will 
be  used  In  the  extrapolation  procedure),  (b) ,  (c)  and  (d)  show  the  extrapola¬ 
tion  obtained  using  h^,  h2  and  h^  as  the  filters,  respectively.  Last,  Table  (3) 
shows  the  corresponding  results  when  h^  provides  the  data. 

The  main  observation  that  can  be  drawn  from  the  examples  is  that,  in 
all  cases,  the  best  extrapolation  is  given  when  the  filter  Is  the  same  as 
the  data.  Another  observation  Is  that  the  h^^  filter  performs  better  than  the 
h2  one  where  the  data  Is  h^  and  better  than  h^  when  the  data  Is  h2.  However, 
we  tried  some  other  examples  using  T  *  and  the  result  was  not  the  same  as 
those  obtained  with  T  It  was  observed  in  that  case  that  when  h2  is  the 

given  data,  h^  performs  better  than  h^^.  On  the  other  hand,  h^^  performs  still 
better  than  h^  when  the  data  Is  h2. 

The  second  approach  used  here  Is  the  Iterative  one  given  in  Theorem  2. 
The  filter  and  the  data  were  chosen  to  be  h^  (therefore,  the  Iterative  technique 
coincides  with  that  given  In  Reference  [1]).  It  is  clear  that  the  Iterative 
approach  is  unacceptably  slow  (Table  4(b)) (the  same  conclusion  was  obtained  from 
other  examples  not  Included  here) .  However,  the  solution  of  (12)  provided  by 
the  Iterative  technique  ((C)  Table  4)  Is  much  closer  to  the  actual  solution  than 
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that  given  by  the  exact  algorithm  [11].  But  the  extrapolation  Is  of  poor 
quality.  The  numerical  properties  of  the  various  algorithms  are  being  studied 
further,  and  ve  hope  to  present  some  of  the  results  In  a  future  paper. 
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APPENDIX 


Theorem  1  (proof) 

The  formula  which  is  to  be  minimized  is 


1 2*  x(m).e^“*‘^|  dui 


But  (Al)  becomes: 


-  G(x) 


0 


ZE 

m  n 


h(m-n)x(m) .x*(n) 


G(x) 


a 


f  A  imuJ  -iktU 

On  the  other  hand,  the  constraint  \  h(u3)^x(m).e  .e  dui  ■  z(k), 

m 

becomes: 


Z1 


x(m).h(k-m)  • 


z(k),  kGCl 


U 


It  Is  easy  to  see  that 

Z  S  h(n-k)x(k)x*(n)  -  f  h(UJ).  [2  x(m)e^''^l  duJ 

kea  n6a  m 

A 

Since  h  Is  non-negative  and  not  Identically  zero.  (a4)  is  always  positive 
unless  x(m)  -  0,  m6^(^  is  finite!).  This  proves  that  H:  h(n-k),  n,  k€^ 
is  positive  definite.  Then,  we  can  write  when  n^^  : 


x(n)  -  2.  £(n,k)z(k)  -  £(n,k).  h(k-m)x(m)  (A 

keci  kea 

*  Jt 

Since  we  have  h(n-k)  ■  h(k-n)  ,  then  the  inverse  c(n,k)  satisfies  £Cn,k)  ■ 
^(k,n)  . 


Taking  conjugates  in  (AS): 


x*(n)  »  |(k,n)z*(k)  -  ^  (k,n)h(m-k)x*(iii)  ,n (A6) 

k€Cl  kea  mfOL 

On  the  other  hand,  equation  (A3)  is  equivalent  to: 


h(n-ni)x(m)  »  z(n)  -  h(n-m)x(m),  n  ^  Q. 

mSQ-  m^CL 

Now,  replacing  (A7)  Into  (A2)  and  using  (AS),  (A6)  we  get: 


(A7) 


G(x)  ■  ^  ^  ^(k,n)z(n)z  (k)- 2  S  2(n)  ^(k,n)h(m-k)x 


- 

n6(Z  k£  Ct 


(m) 


k€A  m^O-  n&X 

+  h(n-m)  2(m,k)x  (n)z(k)  +  \  \  ^ 

n€a  mea  kea 

-  Xj  Xj  h(n-m)x  (n)  ^  h(k-m)x(m)  |?(n,k) 

n^Q,  mea  kea  m  ja 

By  simple  Inspection,  the  second  and  the  third  terms  In  (A8)  cancel  out. 
If  we  put  the  forth  and  the  fifth  terms  together  we  will  have: 


-EC  CE  E  h(n-m)  t  (n. 


(A8) 


k)h(k-m)  x(m)x  (n) 


r  Hl^Ol  n^a  meCL  kea 

It  Is  worth  pointing  out  that  J  does  not  depend  on  x(k),  keCt  and  It  Is  a  quad¬ 
ratic  function  for  x(k),  k^  ^  .  Then,  we  have 


G(x) 


S  Xi  ^(k,n)z(k)z*(n)  +  J(x) 

keO.  neOi 


(A9) 


In  (A9),  the  first  term  on  the  right  hand:  I  Is  non-negative  and  it  does  not  depend 
on  x(m),  Since  G(x)  is  always  non-negative,  it  remains  to  prove  that 


J  ^  0,  to  conclude  that 


min  G(x)  ■  “  t—*  5(k,n)2(k)z  (n) 

k  ^0.  n^O. 


and  that  the  optimum  Is  reached  when  x(m)  >  0,  m^^  .  Then,  equation  (A7>wlll 


become; 


z(n)  ■  ^  h(n-m)x(m),  neQ 

m&Q. 

Now,  let  us  suppose  that  J  <  0  for  some  x(k),  k  ia.  Then,  we  define  a  new 
sequence:  r(k),  k6Z”: 


r(k)  -  Xx(k),  k^Q. 

r(k),  k€Cii 

h(n-k)r(k)  ■  z(n) 

kca 


2  h(n-k)r(k),  n&Q. 

k^a 


(AlO) 


where  A.  Is  some  real  number.  Since  (AlO)  Is  the  constraint  equation  (AS), 
then  formula  (A9)  holds: 


G(r)  -  I  +  J(r)  »  I  +  J(x) 


(All) 


2  2  \ 

Now,  choosing  \  large  enough  we  get  I  +  X.  J(x)  <  0.  This  X  will  lead  to  a 

sequence  r(k),  k£^":  G(r)  <  0.  The  last  assertion  Is  a  contradiction  because 
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c 


Let  us  call  the  optimal  value  of  the  expression  defined  ^n  (13aTt 
subject  to  (13b)  and  (13c);  let  the  optimum  given  by  equation  (12).  If  we 
define  »  h  *  Xq,  then  y^  will  satisfy  conditions  (16a),  (16b)  and  (16c). 

Then  the  optimal  value  of  the  functional  given  In  (15)  satisfies 

Now,  let  y  be  any  feasible  solution  of  the  problem  (15),  l.e.:  y  Is  any  sequence 
which  satisfies  conditions  (16a),  (16b)  and  (16c).  We  define  the  function: 
x:  [-Tr,Tr]“ — 


x(uJ) 


iiiiii  ,ajeOL 
Jl(u3) 


X  has  finite  energy  because  y  Is  bounded  and  \  1  diu  is  finite.  In 

addition,  x  satisfies  equation  (13b)  and  (13c)  (we  consider  x(n)  *  x(ui)j8  ^’^duJ) 

TL 

In  conclusion. 


h  I  ^  \  ^  duj  > 


(A12) 


Equation  (A12)  Implies  ^  Then  ■  M2  and  y^  ■  h  *  x^  realizes  the 

optimum  value  M2. 


c 


Theorem  2  (proof) 


Let  S  denote  the  unit  impulse-response:  ^(m)  >  1  and  S  (m)  ■  0, 
m  0.  It  was  proven  (see[6])  that  the  operator: 


(  S  -  A.  h)  *  X 


(A13) 


defined  over  infinite  sequences  x:  x(m),  m£22",  is  a  contraction  mapping,  i.e., 
there  exists  a  constant  d  <  1  such  that 


(S-Xh)*T^  xll  <  d  11  Tq  x|l  «  d 

g/f.  2  2  2 


(A14) 


In  formulas  (A13)  and  (A14),  denotes  the  truncation  operator  relative  to 

the  set  ^  .  Now,  it  is  clear  that 


x(n)  -  xH  h(n-m;x(m)  :  n€^ 

mea 

is  also  a  contraction  mapping  defined  over  finite-length  sequences:  x(m),  m£^ 
But  the  recursive  formula  given  in  (18)  is  convergent  to  the  fixed  point:  x(n). 


h(m-n)x(n) 


z(ni) 


m  &Cl 


tends 


Now,  denoting  x  ■  x^(m)  +  X(z(m)  -  Z-j  h(m-n)x*^(n)) , 

ned 

since  X  approaches  x  when  k - >  oo  (i.e. , 

to  zero)  we  have: 

h  *  x^ - >  h  *  X  in  the  energy  norm,  k - >  oo  . 

Ic  Ic  Ic 

Denoting  y  »  h  *  x  and  replacing  x  by  its  recursive  form  we  get  (19) . 

Theorem  3  (proof) 

We  know  that  f^  can  be  extended  as  an  entire  function  over  (the  space 
of  n  complex  variables)  by  means  of  the  relation: 

f,(z)  -  \  f.  (uJ).e^*“^duj  zec“.  (A15) 

k  k 

We  will  prove  that  f^(z),  z  €  C,  for  all  k  constitutes  a  sequence  of  normal  func¬ 
tion  over  c"  (see  [7],  [8]).  We  recall  that  a  normal  family  of  analytic  function 
is  uniformly  bounded  over  any  compact  at  K  in  c",  i.e.,  for  each  K  there  exists 
a  constant  c„  such  that: 

Xv 

max  If  (z)l  ^c„,  c„  does  not  depend  on  m. 

'  m  K  N 

z€K 

By  means  of  (A15)  we  have,  for  all  z 


Now,  the  first  factor  on  the  right-hand  of  (A16)  is  bounded  by  hypothesis;  the 
second  factor  is  bounded  in  any  set  of  the  form: 


(z. ,  •  •  • ,  z  )  6  C 
i  n 


for  all 


(A17) 


Of  course,  any  bounded  set  in  c"  is  contained  in  a  set  of  the  form  (17). 

Now,  it  is  well  known  that  any  normal  sequence  of  analytic  functions  in  c"  con¬ 
tains  a  subsequence  which  is  convergent  uniformly  over  compact  sets  (see  [7]). 


But,  in  that  case,  such  a  subsequence  f^j^  has  an  analytic  limit,  l.e.,  for  each 

K  compact  set  in  f^^ - *  g  uniformly  over  K,  where  g  is  an  analytic  function 

over  C  . 

We  need  to  prove  that  g(x)  ■  f(x),  when  x  6  R**.  To  this  end,  we  recall 


),  for  x£  Since  the 

Ically  to  zero  and  is  s 
in  an  open  sxibset  of  ^  ,  say  0  .  Now,  for  any  x  €  ^  we  can  pick  x  arbitrar- 

C  C  CO 


subsequence  of  we  have  that  U  is  also  dense 


sequence  mesh  (S|^)  tends  monoton- 


that  fnk(x)" 


ily  close  to  x  such  that  £n|((^Q)  *  some  function  fnj^*  Since  the 

family  equicontinuous  (because  the  family  is  normal!)  we  have  f(x)  > 

g(x).  Now,  both  f  and  g  are  entire  functions  of  the  real  variables  x6k^» 
and  they  coincide  on  an  open  set  (which  is  open  set  in  ,  not  in  C°! ) 
then,  f  *  g  over  and  the  theorem  is  proved. 
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Theorem  4  (proof) 

By  Theorem  3,  we  know  that  there  exists  a  sequence  f^^  which 
to  f  uniformly  over  compact  sets  of  Mow,  In  addition: 

ftfnkll  2^  11^112  • 

Now,  let  us  define  goj^Cx)  ■  for  all  k  and  x61l*.  Is 

of  non-negative  functions: 

11m  gni,(x)  *  lf(x)j^  »  for  all  x61l“. 
k - >oo 

Now,  the  well  known  Fatou's  theorem  applies  [9]: 

I,  n  inf  f  ^  g„^(x)(ix 

Xv  K  R 

where  11m  Inf  denotes  the  lower  limit  of  the  sequence  Sn^(x)dx. 

Then,  (A19)  Is  equivalent  to: 

2  2 
Ij^nl'M  In^ltalnf  I'n^wl  to 

Mow,  taking  Into  account  (Aid) ,  we  conclude: 

2  2  2  2  2 

j  n  ^  ^  supllfnjjl!  4  1\  f  II 

R  2  1c  2  1c  2  2 

which  means:  llm  \\fnull  exists  and  equals  |lf|| 
k  2  2 


converges 


(A18) 

a  sequence 


(A19) 


(A20) 
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Now,  we  apply  the  well  known  result  which  states:  ^  f  in  the  energy 

norm  if  approaches  f  in  each  point  x  S  R**  ,  and  l\fn|jll2  - ^  11  ^  11  2  [101)  • 

Theorem  5  (proof) 

Since  yxj^(“) .  m£2",  are  samples  of  fj^  at  the  points  mT^,  then 


fj^(lJJ)  -  (T^)“,  F(yT^)(uJT^)  ,  UJ^n 


‘k' 


(A21) 


Replacing  the  expresion  of  yxj^  given  by  (22'),  we  get,  from  (A21) : 
f  (UJ)  -  (T,)".  hx.  (uiT  ).  ^  xx^(n).e^"‘^'^l^. 


Tied 


Now,  I  fj^  jj  2  becomes: 


5 


jf  (UJ)\  du  -  r  •  I  S  ^(n).e^"‘"’^k\ 

L  Jo. 


e^"‘"’^k\  duj  (A22) 


Changing  variables  in  (A22) :  uj  -  ,  we  have: 


11 'I  •  15a 


Now,  (hXk(a)\  -  lb(^)\  «  for  all  ujeriTj^, 


then: 


We  assure  that  the  Integral  on  the  right  hand  tens  satisfies: 


|hT.(UJ)l  .  iS  Xx.(n).e^“^“ 
nea 


1 2  f  A  1  F(f  (nT  ))(uU)| 

\  dui$  I  hi- (UJ)  1 - X -  1 

J  I  hT^(W)  ‘ 


SLT, 


Just  because 


F(f(nff^))<UI) 


satisfies  all  the  requirements  stated  In  p'’opertles 


(13b)  and  (13c).  !therefore»  the  above  Inequality  holds  from  (13a).  Then,  we 
obtain 


11 


F(f(mT  ))  (LU)! 


‘  hrfc(uj) 


I 


dUJ 


Now,  since  F(fnT,  ))(IU)  •  !^(^),  UlfeClT.,  we  have 


T  'T 


11'rII^  «  cl- 


A  uj  2 

f(^)  • 

^k 


«|i) 


duj  . 


Changing  variables  once  more,  we  obtain: 


1  11  ^  f  1  »  where  C.  -  sup  h(uJ) 


'a 


(A23) 


(A24) 


The  bound  we  have  obtained  In  (A24)  does  not  depend  on  k,  therefore,  the  theorem 


Is  proved. 


Remarks 


1.  In  the  particular  case:  h(uJ)  Is  constant  >  then  equation 

(A24)  yields  to: 


proving,  In  that  way,  our  assertion  In  Section  2.2. 

It  Is  clear  that  the  bounds  and  Inequalities  obtained  for  || 
hold  for  11  f,  11  because  of  Parseval's  theorem. 


2. 
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Figure  1:  Frequency  response  of 
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- . OOOOOOOOOOOOOO 
-.09180721036053 
-.17008152549560 
-.23392430863983 
- .2028427121/462 
-.31675032849620 
-.33595619364047 
-.341142/0622721 
-.33333333333333 


-.33333333209066 
-  ,34114270540351 
-.3359561S’311943 
- .31675032818607 
-.23284271230575 
-.23392430856046 
-.17008152546893 
-.09130721036139 
-.00000000001236 
.10404817172734 
.21867624705373 
.34188937415853 
.47140452078774 
.60470517258377 
.73910362601175 
.87180913813916 
1.00000000000366 
1.12089746332030 
1 .23183937668426 
1.330.13137963591 
1.41421356237472 
i .48152062138454 
1.53073372946118 
1.56072257612941 
1.57079632679486 
1,56072257612920 
re.  53073372945978- 
1.48152062138607 
1.41421354237287 
1.33035137968395 
1.23183937668212 
1,12089746331784 
1.00000000000009 
.87180913813851 
,73910362601449 
.60470517259601 
.47140452081793 
.34188937421544 
.21867624715765 
,10404817189742 
.00000000025609 
.09180720995656 
-.17008152487821 
-.23392430772389 
-.28284271115028 
-.31675032662586 
• .33595619105471 
•  .34114270272198 
-.33333332866595 


- .33212189843471 
-.34009071699620 
-.33507094916422 
-.31602603162173 
.28226641294896 
-.23347959440434 
-  .16975023504347 
-.09156945254654 
.00016575946938 
.10415808018297 
.21874561719596 
,3419307465.9650 
. 47142729954794 
.60471687419340 
.73910353683155 
.87181064300239 
1.00000052014366 
1.12039846981689 
1.23183893412352 
1.33035095315427 
1.41421401686966 
1.48152079340070 
1 . 53073390293866 
1.56072259601206 
1 .37079639653332 
1  ,56()7227S'A24641 
1,330733805119/9 
1.43152046650648 
1.41421278472990 
1.33035170286894 
1.23184034787118 
1.12089746817946 
1.00000002421139 
.87180/37033486 
.73909564130008 
,60168173027039 
.47135117556900 
.34178051705262 
.21817126146269 
.10369591601193 
-.00058276951313 
- .09272820223123 
-.17148872371763 
-.23600788880140 
-.28581258441607 
-.32096337247610 
-.34174564853311 
-.31891366795197 
-.34365388518199 


,95068 
-2.14846 
-2.95774 
10.00635 
.98298 
-11,44979 
1,99738 
8,28442 
7.. 43455 
-3.06340 
10,83133 
-10.60697 
8.85064 
-13.10259 
16.92903 
-10.08683 
2.21438 


(a)  samples 


(b)  filter 


(c)  filter  h2 


(d) 


Table  1 


.■►0/07J55.W26307 
.oy204Ao>iyA04:ji 
»H6.<95JHy!31vS52 
.n;j73/yt<695554 
•  i/XlUMAAllS/lSS 
.20670577573798 
.2'13y;518()247901 
.27725416178699 
.51330738618A79 
.•A5B68645669528 
.37772808164897 
.44154310723793 
.48301241353161 
.52377862090405 
.54335591165796 
.60114024788492 
.63661777236757 
.66928511474227 
.69865943602928 
.72430790934640 
.74534645715611 
.76294952571004 
.77535671476286 
.78237310661135 
.78539816339745 
.78287810661135 
.77535671496286 
.76294952571004 
.74584645715611 
.72430790734640 
.67865743602928 
.66728511474227 
.63661V7723.'>757 
.60114024988492 
.56335591165996 
.52379362090405 
.48301241353161 
.44154310728793 
.39992808164877 
.35868645669528 
.31830988618379 
.27725416178679 
.24173180247701 
. 20670577578798 
.17388446837138 
.14371778875554 
,11637584751652 
.092046047.40431 
.07073553026307 


(a)  samples 


.07040772070576 

.07180706713676 

.11622514411765 

.143.59875821901 

.17380323690804 

.20665195120273 

.24187724211601 

.27723275435751 

.31329716815264 

.35867726360697 

.37792424882212 

.44154120949497 

.48301156007438 

.52377828242238 

.56335580275613 

.60114022256630 

.63661777024259 

.67»7285 11270976 

.69865743404147 

.72430770752060 

,74584645579853 

.76294752484386 

.77535671442820 

.78287810632355 

.78537816313787 

,78237810810780 

.77535671670748 

.76274752703938 

.7453464580:h315 

.72430770781525 

.67865743630793 

.6.6728511437823 

.63661777250740 

.60114022133348 

,56335578717424 

. 52377823777665 

.48301144753075 

.44154097639148 

.39992380467993 

,  35867847789903 

.31329536511594 

.27723068777189 

.24189410152030 

,2066473358,6273 

.17379665534827 

.14358961873313 

,1162127500.3426 

.09177061721829 

,07038630328481 


(b)  filter 


.07073561794816 

.09204611672723 

,11639589976154 

.14371802613486 

.17338447568331 

.20670577484828 

.24173181537097 

.27725417032433 

.31830987165388 

.35868646003703 

..19792808357076 

.44154310834652 

.48301241405935 

,52.179862114262 

.56335571174656 

.60114024770777 

.636617/72.17595 

.66928511475460 

.67865943602245 

.72430790734865 

.74584645716737 

.762747525/1689 

.7/5.15671476878 

.78237810661473 

,78537816340307 

,78287310661800 

.775.15671476634 

.76274752571212 

.74584645715186 

.72430770735767 

.67865713604142 

,66723511473769 

, 6366197/236922 

►6011402478635? 

,563.15571155684 

.523/786206143/ 

.483'*!  241289596 

.44154310602372 

. 37772807735747 

,353686452/8140 

,313.{073/784236 

,2/725415175737 

.24173178772657 

.2067057545.1764 

.17388443853136 

,14371774706742 

.116375/7289628 

.07204577452.543 

.0/073543248842 


(c)  filter 


.0702332.1430517 
.07170373336017 
.11614054013444 
,1135307.1077706 
.17374763148723 
.20661061305600 
,24136577831114 
.27720780288991 
.31828083532127 
.35866310561129 
.379716/7003854 
.44153665460544 
,  43.100836747254 
.523/7684300104 
.56335524174210 
.60113774126732 
.63661785326326 
.66928518170980 
.69865757064030 
. 72430/98008281 
.74584649654571 
.76294959575543 
.7/535678784714 
.78287817141406 
'  .735.1732.1752362 
.782378174/02/7 
.77535685000475 
.76274753582730 
.74584647003212- 
.72430/87121427 
,67865736471615 
.66728516683402 
.63661780154575 
.60111073456478 
.56335678824687 
.52380041847937 
.43301547151611 
.44154/66041902 
.39773480429985 
.,1586955263/450 
.31832146469769 
.2/726802597358 
,24171743131189 
,206721/370/362 
.17389837244991 
,  14.1/2617637.110 
.11637327218233 
.07202537437683 
,07063720560985 


(d)  filter 


Table  2 


•.'^2  7069  3  iSS  112.3 
'.017V5A2!j()'iS25y 
.07ia97<)3112A19 
.0ysa2d2‘7Vi0364 
,  i28Al!i21MS3723 
,U107S<)4V474.t5 
.  iy59;i60<)707Vi;i 
.23295003701983 
.271 394 4823 11 53 
.31177712034439 
.35274243805386 
..394099045176/0 
.43532806817473 
. 47589235714680 
.51524630666027 
.55284607557846 
.58815997768240 
.62067330758574 
.64992586507037 
.67546644561665 
.696916.57.549290 
.  71395078606598 
.72630874360551 
.7.1.18005772.^727 
.73631077818511 
,73380057723727 
,726308  74:1605,')! 

, 71395078606598 
.69691657549290 
.67546644561665 
.64992586507037 
.62067880758574 
.58UA59977/)3240 
.55284607557846 
.51524630666027 
,47589235711680 
. 43532806817473 
.39409904517670 
..15274243805:186 
.31177712034439 
.27169448261153 
.23295003701988 
.  19595600707915 
.16107504947415 
.12861522453723 
.09882629910364 
.07189743112649 
.01795625045259 
,02706931551123 


(a)  samples 


.02724024788662 
,04308069670699 
,07198622347425 
,09888825957307 
,12365740733525 
.16110298453009 
.19597393674053 
.2:1296113969786 
.27170107683287 
.31178084849944 
.3527444229:1098 
,39410002622344 
.43532850755059 
.47539252927855 
.51524636078511 
.55284608727874 
.58815997756463 
. 62067880756376 
.64992586508015 
.67546644572781 
.6969165756:5999 
.71395078619935 
,726:10874.198283 
.73380057743725 
,73631077833670 
,733800577,16281 
. 72630874380320 
.71395078611295 
.69691657549720 
.67546644558297 
,64992586503104 
.62067830756058 
.58815997763250 
.55284608753118 
,51524636063004 
.47587252798116 
.435:12850357673 
.39110001672059 
,35274440389453 
.31178081358939 
,271701017514/2 
.23296104422752 
.19597378989101 
,16110276700765 
. 12865709531980 
,09888782433086 
.07198563121:193 
. 04807990855079 
.02723921979354 


(b)  filter 


.02728325889484 

.04811376662349 

.07201122652987 

,09890682281275 

.12867081:919211 

.16111251925213 

.19593048593070 

.23296549821316 

.27170387679143 

.31178254244151 

.352745:19155216 

.39410053651227 

.435320743.153:17 

.47589262390102 

.515246:18223054 

,5:3284609177033 

.58815998073260 

.62067880542600 

,64992535710401 

.67546645560651 

.69691658983356 

.71395073871365 

.726:10371384777 

.73:18005/633337 

.7363107801:1568 

.73380057871691 

.72630874358583 

,71:195073796195 

.69691657955991 

.67546645959374 

,649925867.11946 

.62067879870301 

.58815997920465 

,55284605076304 

.5152462:166:1863 

.475892216432!!4 

,4353278474.1002 

.39409871897683 

.3527’42i2755030 

,311/769499.16/6 

.27169476405«;t4 

.23295131453779 

,19595913341618 

. 161081382713/5 

. 12862672927440 

,09881571211296 

.07192846:167252 

.04800384695409 

.02713990503980 


(c)  filter 


.02707309650113 

.04796306:118423 

.07190262543278 

.09883013280317 

.12861806695604 

.16107708072308 

.19595712079806 

.23295099057496 

.271.19510315362 

.31177750725629 

.35274266819135 

.;19409917216904 

,4353231333.1354 

. 47589238688397 

.  51524631 7:;823? 

,55284607917753 

.58815997722718 

.62067880764443 

.6499253.1522635 

.6/546641655317 

.69691657633894 

./1 3950/8622822 

.72630874:184572 

.  ;.i;480057744998 

,/:;,i;il07/833352 

.  7;i;i80057722443 

,726.50874366723 

.713950/8649857 

,6969165757.1912 

.67546644542790 

..1499253.11/1226 

.62067880631018 

.58815997730152 

,55281607317345 

.51524630332415 

.475892;i4811176 

.  i:;53:MJ0 1765255 

.39409900;ii45i3 

,352712.15400675 

,3.U;';M96779i05 

.2/169421974077 

.:4;!294960591011 

,19595532821565 

.1610/402072680 

.I.28.1i:i7i;i9272S 

,09:582  U  121H987 

.■:)V.r8?1425S620? 

.0':;'952 158.17589 

.0:;7065i55<!/H'127 


(c)  -ilter  hj 


Table  3 


-,29AAi97i2/^*.}y7 
-.:>{}.5;u57i7yo79i 
-  *iv>()]ii280'io»y;ja 
••>2227S0y401i;770 
-,i7itji;i4i58oyA2 
-•>10AS4S783204y3 
-.0283<i'173i0ao;t7 
.0A21>t  338290023 
*16373390021311 
.2768;467A3y4<)20 
»393a61‘463>l4383 
.51777821793723 
.64513850363114 
.77314416915926 
.89920776342764 
1.02071832608082 
1.13510876964443 
1 ,23992291808134 
1.33288026117779 
1.41193633875738 
1,47533338138218 
1.82167040188691 
1.54989334965484 
1 .55737220033535 
1,34987334765485 
1.52167010188689 
1,47333838138218 
1,41173653375738 
1.33288026117779 
1.23772271803136 
1.13510876764443 
1.02071832608082 
.89720776342964 
.77314416915726 
,64513850363114 
.51777821773723 
.39356146344382 
,27483176394019 
.16373590021310 
,06214358290022 
- .02836473105037 
- ,10654576320493 
-.17151341580962 
-.22275094012770 
-.26011280408958 
-.28381571790791 
-.29441971273457 
-.27279990487287 


-.08713507494 
.111162110041 
.2967.t5;l43258 
,464075988913 
.6083i:'4559S53 
.7251838889833 
.8112216050677 
.863881926879 
.8816144321237 
.863881726879 
.8112216050677 
.7251838887833 
.6033174359853 
.4610759887181 
.296715143258 
.11  U.62110011 
-.087135071742 


(a)  filter  solution  of 

after  50  iterations  the  system 

^  -  1/3.14 


Table  4 


Sam  ASPECTS  of  band-limited  signal  EXTRAPOLATION; 


MODELS,  DISCRETE  APPROXIMATIONS,  AND  NOISE 

Jorge  L.  C.  Sanz 
Thomas  S.  Huang 

Coordinated  Science  Laboratory 
University  of  Illinois  at  Urbana-Champalgn 
1101  W.  Springfield  Avenue 
Urbana,  Illinois  61801 

ABSTRACT 

We  present  some  theoretical  results  on  the  band-limited  signal 
extrapolation  problem.  In  section  I  we  describe  four  basic  models  for 
the  extrapolation  problem.  These  models  are  useful  In  understanding  the 
relationship  between  the  continuous  extrapolation  problem  and  some  discrete 
algorithms  given  In  refs.  [I]  and  [2].  One  of  these  models  was  shown  to 
approximate  the  continuous  band-limited  extrapolation  problem  ([3]). 

Another  model  Is  obtained  when  DPT  Is  used  to  Implement  the  well-known 
Iterative  algorithm  given  In  refs.  [4]  and  [5]  which  was  designed  for 
solving  the  continuous  extrapolation  problem;  in  section  II  this  model  Is 
related  to  the  continuous  model.  We  also  present  some  new  techniques  for 
solving  the  continuous  extrapolation  problem  when  the  known  part  of  the 
signal  to  be  extrapolated  Is  contaminated  with  noise  n(x)  :  max  |n(x)|  £  e. 

X 

In  section  III  we  show  that  the  extrapolation  problem  Is  very  sensitive 
to  noise  even  In  cases  where  only  small  amounts  of  extrapolation  are 
desired.  This  result  Indicates  that  In  the  presence  of  noise  extrapolation 
techniques  should  be  used  Judiciously  In  order  to  obtain  reasonable  results 


III.l 


I.  Introduction 


Let  us  begin  by  recalling  what  la  meant  by  continuous  band-limited  extrapo¬ 
lation.  Let  f  be  a  finite  energy  ftcnctlon  defined  over  the  real  line; 

(f  e  L^ 


f! 


f(t)l^  dt  4.  00 


(1) 


Let  us  suppose  that  Its  Fourier  transform  f  Is  zero  outside  [-11, Cl]:  f(<u)  ••  0, 
ui  ^  [-il,Q  ].  Since  f  Is  analytic,  given  a  piece  of  f,  say  g  ;  [-T,  T]  —  C  : 
g(t)  ■  f(t),  t  €  [-T,  T],  we  can  expect  to  recover  f(t),  when  t  ^  [-T,  T]  from 
g.  Hence,  the  continuous  extrapolation  problem  Is  (under  the  conditions  stated 
above ) : 

Find  f(t),  t  4  [-T,  T] 
given  f(t),  t  e  [-T,  T]. 

(see  fig.  1(a)).  This  model  will  be  referred  to  as  the  continuous-continuous 
model.  The  finite-energy  property  of  f  ensures  that  f  is  a  function. 

Moreover,  It  can  be  shown  that  (Farseval's  Identity) 


|tP  <ta 


(2) 


The  band-limited  property  assximed  for  f  gives  us  the  following  Inversion 
formula: 


f(t)  •  ^  /  ?(«»)  d" 

A  ^  /  i«Jt 

H^ertheless,  f(u})  may  not  be  written  as  I  f(t)  e  dt,  since  f(t)  is 


(3) 


not  Integrable  on  the  real  line. 


III.  2 


One  possible  way  of  getting  an  extension  of  the  Fourier  transform 

for  non-lntegrable  functions  Is  by  means  of  the  distribution  theory  [6]. 

A  2 

(The  Fourier  transform  f  for  f  ^  L  can  be  understood  In  the  distributional 
sense).  Probably,  the  most  Important  mathematical  consequence  to  slgna-1 
analysis  of  such  en  extension  Is  to  get  a  rigorous  definition  'of  the  Fourier 
transform  for  continuous  periodic  signals. 

Let  f  be  a  F-perlodlc  signal  defined  over  the  real  line: 

f(t)  -  f(t  +  P)  for  all  t,  (4) 


and  let  us  suppose  that  f  Is  fZ-band-*llmlted.  This  means  that  Its  dlstrlbu- 

A 

tlonal  Fourier  transform  f  Is  supported  In  [-12,  Q].  In  that  case  It  can 

A 

be  proved  that  f  Is  a  linear  combination  of  Impulses.  The  weights  In  that 
linear  combination  are  related  to  the  DFT  of  samples  of  f.  Now,  we 
have  another  model  for  the  band- limited  extrapolation  problem,  which  we  call 
continuous -discrete ;  given  a  piece  f(t),  t  €  [“T,T],  of  a  Cl-b and- limited 
P-perlodlc  signal  f(t),  we  want  to  determine  f(t),  t  ^  [-T,T]  (see  fig.  1(b)). 
The  solution  for  this  extrapolation  model  Is  unique  since  f  Is  analytic. 
Moreover,  f  Is  a  linear  combination  of  exponential  functions: 


The  two  models  given  In  fig.  1(a)  and  1(b)  are  both  concerned  with 
the  continuous  extrapolation  problem;  this  means  that  the  signals  to  be 
extrapolated  are  continuous  In  time.  Nevertheless,  In  the  first  case  the 
Fourier  transform  Is  also  continuous  In  time,  while  in  the  second  case  the 


III.  3 


Fourier  transform  Is  a  finite  array  of  Impulses.  There  is  a  major  difference 
in  solving  the  extrapolation  problems  for  the  two  models:  the  P-perlodic 
Cl-band-llffllted  function  is  completely  determined  by  2k^  -4-  1  samples  In 
[*T>  T].  This  assertion  Is  a  consequence  of  (5) ([!]).  Of  course,  this  Is 
rot  the  case  for  model  (la). 

An  attempt  to  solve  the  extrapolation  problem  given  In  model  (la)  Is 
the  following  well-known  Iterative  procedure  [4],  [5]: 

'o  -  0 

*«■!  ■  (»  +  o  -  ■’t-T.T]>  y 

where  I  is  the  identity  operator  and  is  the  tnincatlon  to  [-T,T] .  One 

possible  way  of  getting  a  ntimerical  implementation  of  the  recursive  formula 
(6)  la  based  on  the  following  identity 

■  ‘n  *  “"'a*  ■  •^-T.T]  'n  >  .  ■‘>0  <«') 

In  addition,  it  is  necessary  to  sample  the  functions  and  the  convolution 
In  (6*).  After  doing  that  we  get  the  following  discrete  recursion: 

^n+l^^  (A(j-m))(g(mA)  -  y„(m)))  (7) 

“  Am€(-T,T]  ^  “ 

y„(J)  -0 

where  L  denotes  the  distance  between  two  consecutive  samples  and  j  Is  any  integer 
number.  Now,  it  la  clear  that  “y  not  be  It  is  well- 

known  that  £q***1^  uniformly  on  the  real  line.  On  the  other  hand,  it  was 
shown  In  [2]  that  the  sequence  y^  tends  to  the  minimum  norm  solution  y  of 
the  following  discrete-continuous  extrapolation  problem  of  g(mA)  ■  a(m). 


Given  z  (n) ,  m  &  k  (A  is  s  finite  set  of  Integer  nuai>ers)  find  a 


finite-energy  sequence  7(b),  m  6  Z : 

(1)  7  Is  band- limited  to  (-11,0). 
(11)'  7  (b)  *  z  (m)  ,  B  €  A. 


Under  condition  (1),  the  band- limited  property  should  be  understood 
in  terms  of  the  Fourier  series  of  y,  that  Is  to  say 

+  00  . 

F(y)(w)  ■  Y,  y(“)  ®  ^  "  0  when  1  col  >  Q 

Bs-oo 

This  Is  the  third  model  sketched  in  Fig.  1(c).  This  model  appears .as  a 
consequence  of  the  numerical  implementation  of  the  recursion  (6').  However, 

It  Is  also  clear  that  the  extrapolation  problem  which  the  recursive  formula 
(7)  approaches  Is  completely  different  from  the  original  problem  (model  1(a)). 
In  ref.  [3]  model  1(c)  was  fully  connected  with  model  1(a). 

Another  technique  of  Implementing  the  recursive  relationship  (6)  is 
by  means  of  the  discrete  Fourier  transform  (DFT).  Equation  (6)  can  be 
written  In  the  following  equivalent  form: 


“■n+l 


“n+1 


(8a) 

(8b) 


where  trxincatlon  function  to  [-i2,Q],  v  and  A  denote  Inverse 

and  direct  continuous  Fourier  transform  respectively.  Replacing  V  and  A  by 
their  corresponding  DFT  and  Implementing  the  frequency  cut-off  operator  In 
terms  of  samples  of  the  frequency  space,  we  get  the  following  recursion 
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m— N 


J  €  [-N,  N] 


oC(m)  - 


M>lml>k^.(^ 


.  E  W) 

j— N 


-2irijm/M  Inl  4  k 

Q  o 


fid) 


g(JA), 


MI  4  [|l 


N  >M\  >  [J] 


In  formulas  (9b)  and  (9c)  A  denotes  the  distance  between  consecutive  samples 
which  Is  used  to  extract  values  of  g  Inside  [-TyT]»  and  to  approach  the 
continuous  Fourier  transform;  M  -  2N  +  1  is  the  length  of  the  DFT.  There 
Is  no  a  priori  evidence  that  Justifies  the  convergence  of  the  procedure 
given  by  (9)  because  is  not  proven 

that  if  ■  [^J  ■  L  then  converges  to  the  solution  of  the  following  . 

discrete-discrete  extrapolation  problem 


Given  the  sequence  x(n),  -L  4  n  4  L 

Find  a  sequence  h (n) ,  -N  4  n  4  N  such  that 


(1)  h(n)  is  band-limited  to  [-k  ,  k  ] 

o  o 

(11)  h(n)  «  x(n),  n  6  t-L,  Ll 


(10a) 

(10b) 


Condition  (1)  should  be  \mderstood  in  terms  of  the  DFI. 


J]  h(n)  ,“2Trinm/M  ^  q  N  >  lm\  >  L,  M  -  2N  +  1 

n*-N 


Fig.  1(d)  sketches  this  new  model  for  the  extrapolation  problem. 
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In  ref.  [I]  it  was  assumed  that  the  number  of  non-zero  ,  iquencles 
Is  the  same  as  the  number  of  given  samples:  x(n),  n  G  [-L.L].  Neverthe¬ 
less,  as  well  as  It  was  done  for  the  discrete-continuous  model  (c) ,  it 
should  not  be  difficult  to  prove  that  when  >  [^]  the  same  algorithm 

(9)  converges  to  the  minimum  norm  sequence  h(n)  which  satisfies  (10a), 

T 

(10b).  The  case  ^  ^  yield  any  solution. 

It  is  clear  that  the  discrete-discrete  model  is  completely  different 
from  the  continuous-continuous  model.  Nevertheless,  it  naturally  appears 
from  another  numerical  implementation  of  equation  (6).  Unlike  the  discrete- 
continuous  case,  this  model  has  not  been  connected  to  the  continuous-continuous 
cas^'.  In  other  words,  no  one  has  shown  how  the  extrapolation  obtained  by 
means  of  the  discrete-discrete  model  is  related  to  the  original  continuous- 
continuous  problem.  It  is  worth  pointing  out  that  the  recursive  equation  (9) 
is  just  a  method  of  getting  the  extrapolated  sequence  given  by  equations  (10a) 
and  (10b) .  Hence  the  solution  provided  by  the  algorithm  (9)  was  not  related 
to  the  continuous  solution.  Some  relationships  between  models  1(a)  and  1(d) 
will  be  given  in  Section  II.  Nevertheless,  we  did  not  get  the  same  class  of 
relationships  we  had  obtained  for  the  connection  between  models  1(a)  and 
1(c)  ([3]).  To  end  this  section  we  would  like  to  point  out  that  the  continuous- 
discrete  1(b)  and  discrete-discrete  1(d)  models  are  closely  related.  This 
is  because  a  continuous  F-perlodic  (1-band-llmited  function  is  completely 
determined  by  the  samples  f(n/0  where  satisfies: 

^  >  Cl  and  ■  2N  +  1 
Then,  if  A  is  small  enough  so  that 


II.  MAIN  RESULTS 


This  section  is  divided  into  two  parts.  The  first  part  (II. a)  is 
devoted  to  the  6-tolerance  band-lisiltdd  extrapolation  problem.  The  second 
part  (II. b)  is  concerned  with  further  relationships  between  the  discrete- 
discrete  model  and  the  continuous -continuous  model  for  the  band- limited 
extrapolation  problem.  All  proofs  are  relegated  to  the  Appendix. 

Il.a 

In  this  Section  we  address  the  6 -tolerance  band- limited  extrapolation 
problem.  We  present  some  theoretical  results  and  their  application  to  the 
extrapolation  of  noisy  signals.  These  results  show  that  the 
discrete-discrete  model  and  the  discrete-continuous  model  can  be  applied 
to  obtain  approximations  for  a  continuous-continuous  extrapolation  problem 
in  the  presence  of  noise.  Let  g  be  a  piece  of  an  Q-band-llmited  signal, 
g  :  [-T,  T]  ”*'C,  and  €  be  any  positive  number.  Then,  the  €-tolerance  band- 
limited  extrapolation  problem  can  be  stated  in  the  following  way: 

Find  h  :  R-«-C; 

h  is  band-limited  to  (11a) 

lh(t)-g(t)U6  fort6[-T,  TJ.  (11b) 

It  is  clear  that  conditions  (11a)  and  (11b)  do  not  define  h  uniquely  (see 
Section  III).  Theorem  1  and  Theorem  2  present  two  techniques  for  getting 
a  solution  of  this  problem.  The  techniques  are  based  on  the  approximation 
of  the  solution  by  means  of  the  discrete-discrete  model  (adapted  for  the 
^-tolerance  case).  On  the  other  hand.  Theorem  3  presents  a  different  approach 
based  on  the  discrete-continuous  model  (adapted  for  the  E-tolerance  case). 


In  the  latter  case,  we  obtain  a  solution  of  (lla)  and  (lib)  which  is 
characterized  as  the  minimum  energy  band- limited  function  among  those  which 
satisfy  (lla)  and  (11b) 


«r 

observe  that  the  deflnltloa  of  A  ensures  that  M  >  k  . 

‘A  o 

It  is  clear  that  the  sequence  of  functions  ^^constitutes  a  family  of 

MA'Perlodlc  Qrband- limited  functions.  The  condition  (13a)  merely  says 

that  Vfl  satisfies  \  *f(nA)  -  g(nA)  |  4  when  n&  s  [-T,  T] .  In  addition, 

^  A 

condition  (13b)  is  a  technical  requirement  to  ensure  that  can  be  bounded 

A 

on  compact  sets  in  the  complex  plane  (a  detailed  proof  is  Included  in  the 
Appendix) . 

It  is  also  clear  that  conditions  (13a)  and  (13b)  can  be  put,  for  M  >■  2' 
in  this  equivalent  way: 

We  seek  for  a  M-periodic  sequence  y (n) ,  n  e  (-•,  +•)  such  that : 

(a)  y  is  band- limited  to  f-k  ,  k  ]. 

o  o 

0>)  ly(n)  -  g(n£0\  4  e  for  n  fe  [-k^,  k^] . 

(c)  If  z  denotes  the  M-point  DFT  of  y,  then  z  minimizes 
N 

]z(k)l,  where  y  satisfies  (a)  and  (b). 

k— N 

Conditions  (a)  and  (b)  are  the  discrete-discrete  counterpart  of  the  problem 
which  Theorem  1  salves.  Condition  (C')  is  an  additional  constraint  ((a)  and 
(b)  do  not  define  y(n)  uniquely)  that  makes  the  connection  b etween  both 

problems  possible.  There  is  another  (c)-type  constraint  which  also  leads 
to  a  solution  of  the  continuous  extrapolation  problem  with  ^-tolerance. 

That  is  the  purpose  of  the  next  theorem. 


Theorem  2 


Under  the  same  conditions  and  assumptions  as  In  Theorem  1,  If  we 

replace  condition  (13b)  by  the  following  one; 

k  ^ 

minimizes  2^  lz(k)l  among  those  which  satisfy  condition  (13a) 


k— k 


(13b') 


then,  the  same  conclusion  as  In  theorem  1  holds:  There  exists  a  subsequence 
L  0  such  that  'f.  h'  uniformly  over  compact  sets  and  h'  Is  a  solution 
of  (11a)  and  (lib). 


We  have  already  pointed  out  that  the  continuous -continuous  extrapola¬ 
tion  problem  with  €-tolerance  has  no  unique  solution.  Hence  the  extrapo¬ 
lated  signal  h  given  In  Theorem  1  and  Its  counterpart  h'  given  In  Theorem  2 
may  not  coincide.  The  characterization  of  these  solutions  has  not  yet  been 
found.  However,  It  Is  our  conjecture  that  the  solution  provided  by  Theorem  2 
Is  the  minimum  noisy  signal  among  those  which  satisfy  conditions  (11a)  and 
(11b) . 

Another  possible  approach  is  obtained  by  means  of  the  continuous- 
discrete  model.  In  this  case,  the  solution  h"  can  be  characterized  as  the 
minimum-energy  (l-band-l  loll  ted  function  which  satisfies 

I  g(x)  -  h’'(x)  U  €. 

X6[-T,T] 

Nevertheless,  Its  computation  may  be  more  Involved. 
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Theorem  3 


Let  ^  and  A  be  any  two  po'sitlve  numbers.  Letg  :  [-T,  T]-^Ca 

piece  of  a  H -band- limited  finite  energy  function  f.  For  each  A<2T  we 

T 

define  the  function  f ^  as  follows:  (L  ■  [^]) 


f^(x) 


z 

k€(-L,L] 


x^(k)*sinc^(x  -  kA) 


where 


x^(k)  is  the  solution  of  the  following  optimization  problem: 


I 


minimize  x(k)  z(k) 

-L4k<L 


(14a) 


subject  to: 


*(k)  -  gOib  1  ^  €  ,  -L  4  k  4  L 


(14b) 


I 

-L4k4L 


x(k)  sinc^tA(i-k)]  «  z(i) 


-L  4  i  4  L 


(14c) 


Then,  there  exists  a  sequence  0  such  that  h"  uniformly  over 

n 

compact  sets  in  the  real  line.  Here,  h"  denotes  the  minimum-energy  function 
which  is  band-limited  to  [-Q, Cl]  and* satisfies 


max  lg(x)  -  h"(x)  \  4*  g 

X€r[-T,Tj 


Moreover,  it  can  be  shown  that  f.  approaches  h"  uniformly  on  the  whole 

^m 

real  line. 


It  is  worth  pointing  out  that  the  function  f^  constructed  in  the  theorem 
is  just  the  minimum- energy  Q-band- limited  function  that  satisfies 


max  \g(kD  -  f.(kA)l  4  G 
ke[-L,L]  ^ 


(15) 
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It  is  also  interesting  to  observe  that  Theorem  3  requires  f  to  be  of  finite- 
energy  only.  On  the  other  hand,  ^eorems  1  and  2  require  absolute  summability 
of  f.  This  last  property  ensures  that  f  is  smooth  (at  least  a  continuous 
function  ).  Hence,  simple  cases  such  as  f(x)  »  sinc^(x)  are  not  included 
in  the  first  two  theorems  given  above. 

The  techniques  presented  here  are  potentially  useful  for  getting  solutions 
of  the  extrapolation  problem  in  the  presence  of  noise  >j(x)  in  the  observed 
portion  of  the  signal.  Let  us  assume  that  |>|(x)|  &  S  and  that  we  are  given 
a  noisy  observation  g(x)  «g(x)  +  when  x  e  [-T,  T] .  Theorems  1,  2  and 

3  hold  when  g(x)>  is  replaced  by  g.  This  means  that  theorem  1  and  theorem  2 
give  us  two  Cl-b  and -limited  functions  h  and  h'  such  that:  (6-  2S) 

lh(x)  -  g(x)l  6  and  |h'  (x)  -  g(x)  1  6 

when  X  €  [-T,  T] .  Theorem  3  also  constructs  a  Orb and- limited  function  h" 
such  that  jh'’(x)  -  g(x)  I  4  %  with  the  minimum- energy  property.  The  potential 
difference  between  techniques  as  presented  in  Theorems  1,  2  and  3  may  lie  in 
the  numerical  methods  used  for  salving  the  optimization  problems.  Further 
research  is  being  done  on  this  problem. 


Il.b 

In  this  section  more  theoretical  relationships  between  the  discrete- 
discrete  model  and  the  continuous -continuous  model  for  the  band-limited 
extrapolation  problem  are  presented.  The  main  goal  is  to  try  to  construct 
an  approximation  of  the  continuous-continuous  problem  by  means  of  the 
discrete-discrete  model.  The  main  result  is  given  by  the  following  theorem. 
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Theorem  4 

Let  g  :  [-T,  T]  C  be  a  piece  of  a  Cl-band- limited  function  f  which 

la  supposed  to  be  absolutely  summable.  There  exist  two  sequences  of  positive 

real  numbers  &  0  and  ^  0. 

n  n  * 


— r  ■  M  an  Integer  number 
n 


and  a  sequence  of  functions 


o  2lTikx 

£  Z  *6(k)  .*  Vn 

k--k  % 
o 


wl.ere  z-  (k),  -k  4i  k  4  k  , 


f  °  Va] 

L  2"  J  ’ 


is  the  solution  of  the  following  optimization  problem: 


‘  ®  .  g(mA)  4  6  ,  m  €  [-k  ,k  ] 

n  k»<-k  n  nn  o  o 


*n  k»-k  n 
o 


(I6a) 


minimize  ^  |  z  (k)  [ 

k—k  ®n 
o 


(16b) 


such  thatV 


A  ^  ^  uniformly  over  compact  sets  in  the  real  line. 

A-*0 


‘S'n-O 


This  theorem  asserts  that  it  is  possible  to  get  an  approximation  of  f 
by  means  of  the  discrete-discrete  model.  Nevertheless,  conditions  (16a) 
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and  (16b)  are  not  equivalent  to  matching  the  given  samples  g(m^)  via  DFT 
of  a  sequence  z  (k)  which  is  zero  if  k  6  •  That  is  what  the 

discrete-discrete  version  of  Papoulis'  algorithm  carries  out,  as  was  pointed 
out  in  Section  I.  This  problem  is  as  far  as  we  know,  an  open  problem.  We 
would  like  to  point  out  that  this  problem,  far  from  being  a  merely  theoretically 
Interesting  question,  is  the  only  result  which  might  ensure  that  the  DFT 
Implementation  technique  of  Papoulis'  algorithm  does  approach  the  real 
extrapolation.  Hence,  we  would  like  to  state  the  following: 


Conjecture 


Given  g  :  (-T,  T]  C  a  piece  of  a  Q- band -limited  function  f  (which 

should  be,  at  least,  absolutely  summable),  let  ^  be  a  real  positive  niin^er 
2 

such  that  2FT/a&  is  an  Integer  nusiber  M.  Let 


-2Tril»./M^ 


“  “  k«-k 

o 

be  a  family  of  functions  where  z(k)  is  defined  by  the  condition  (k 


1  r*® 

y(n&)  »  g(nA)  -  w  •  X  z(k)  •  e 

^  “  k— k 

o 


-2Trikn/M 


-k  4  n  4  k 
o  o 


Then,  there  exists  a  subsequence  ^  0  such  that  4a 


f  uniformly 


over  compact  sets  in  the  real  line. 
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III.  NOISE  SENSITIVITY  OF  THE  BAND-LIMITED  SIGNAL  EXTRAPOLATION  PROBLEM 


It  Is  well-known  that  the  band- limited  signal  extrapolation  problem 
is  a  very  ill-conditioned  problem  since  a  small  amount  of  noise  Implies  that 
there  may  be  no  solution.  A  related  problem  is  how  to  decide  if  some  approx¬ 
imation  of  the  extrapolated  signal  is  sufficiently  close  to  the  real  extra¬ 
polation.  Since  we  are  only  given  a  piece  g  (eventually  noisy)  of  the  signal 
to  be  extrapolated,  all  the  criteria  should  lie  on  comparisons  between  the 
approximations  and  g.  It  is  clear. that  it  should  not  be  expected  that 
closeness  to  g  implies  closeness  to  f  over  the  whole  real  line.  Nevertheless 
it  might  be  reasonable  to  believe  that  if  only  a  small  amount  of  extrapolated 
information  was  desired,  (l.e.:  up  to  an  Interval  (-T',  T')  where  T  <  T'  ^  oo) 
then  there  would  be  a  constant  C  (which  does  not  depend  on  the  signal)  such 


that 


when 


Ik -VI.  C.S 


II*  -  vl 


[-T,T] 


4 


6 


where  ^ is  the  approximation  to  the  extrapolation  and  €  is  any  positive 
number. 

Unfortunately,  this  is  not  the  case  in  general.  The  function  ^ may 
be  a  C2-band-limited  function  which  is  close  to  f  inside  [-T,T]  and  might 
differ  from  f  in  [-t',T*|  as  much  as  we  want.  The  next  theorem  states  this 
result  more  explicitly. 
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Theorem  5 


Given  any  positive  numbers  ^  and  G,  and  given  £  and  g  as  above,  let  F 
be  any  point  in  [-T',  T']  such  that  P  ^  [-T,  T] .  Then,  there  exists  a 
A -band- limited  function^p  that  satisfies: 


,[-T,T] 

-  81  4  € 


|V4,p(p)  -  *ff)|  >  e 


Theorem  5  shows  .that  future  research  on  this  stibject  should  take  into 
account  that  some  small  noise  in  the  observation  or  small  errors  in  [-T,  T]  in 
the  approximation  of  the  signal  to  be  extrapolated  may  mean  large  errors 
outside  the  known  range. 
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IV.  APPENDIX 


We  will  need  a  lensna  for  proving  theorems  I,  2  and  4.  This  lemma 
states  a  well-known  result  related  to  the  approximation  of  the  continuous 
Fourier  transform  by  means  of  the  discrete  Fourier  transform  (DFT).  We 
Include  oiir  proof  here  because  It  follows  the  same  Idea  as  the  theorems' 
proofs. 


Lemma  1 

Let  f  :  R be  a '^-b and- limited  function  which  Is  absolutely  aummable 
Let  M  be  a  positive  Integer  number  M  ”  2N  +  1  and  be  where  A  la  a 

positive  real  number  given  by 


If  we  put 


j  *  e 

n—N 


-2mkn/M 


k  6  [-N,  N] 


and  If  we  define 


•  M  •  Z.  V)  .  *  6  S 


k— k 


we  will  obtain  a  sequence  A  0  such  that 

Ql 

^  f  xmlformly  on  compact  sets  In  R. 


proof 


First,  we  prove  that  converges  to  f  In  the  weak  sense,  l.e.,  given 
any  function  L  such  that  L  Is  a  smooth  function  that  also  has  compact  support 
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f  (f>^x)  •  L(x)  dx  —  r  f  (X)  L(x)  dx  . 

I  I*(x)  dx  -  2  M  *  Z 

•Ico  k— k  n^N 


,27rikn/M  .  ^|2kTrj 
MA  ' 


Now  If  we  call  Q  »  MA  (Al)  will  become 


f  Z  *(n« 


k»-k  n—N 
o 


Since  0  Implies  Q  -*•»,  formula  (A2)  becomes 


^  /  /  f(x)  e^^^LCto)  dx  du>  (/ 

-oo 

V 

I  ^  v»*aA 

But  since  /  f(x)  e  dt  «  0  If  [-C,Cll,  then  (A3)  Is  Identical  to 


♦•«0 


aV  /  I 


f(x)  e^’'“^L(uj)  dt  dOJ 


(M)  Is  exactly 


f<x)  L(x)  dx. 


Now  we  prove  that  there  exists  an  analytic  function  f  ;  R  -*0  and  a  sub¬ 
sequence  0  such  that 

I 

f  uniformly  on  compact  sets. 
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i  to 


Since  converges  weakly  to  f  then  f  ■  f  almost  everywhere.  But  both  f 
and  f  are  smooth  functions.  This  implies  £(x)  «  £(x)  for  all  x  €  R. 

Let  z  be  any  complex  number.  Let  us  extend  the  definition  of  to 
complex  arguments  z  as  follows: 


I*  (f  t(n« 

k«-k^  n*“N 
o 


Now  it  is  easily  seen  that 


•  I  |*{nA)l  •  .1^'^ 

^  "  H--K 

2ko 

But  ^  ~  »  therefore  equation  (A6)  becomes 
W  TT 


1 4  S  . A  f;  .  .li“IQ 

^  "  n— N 


When  A-*  0  the  right-hand  term  in  (A7)  tends  to 


/Uc*,l 


Then  there  exists  a  constant  C  such  that 


I  ^  (z)  1  4  C  •  . 


is  a  family  of  analytic  functions  on  the  complex  plane.  In  addition, 

(AS)  says  that  this  family  la  uniformly  boxinded  on  compact  sets  in  C.  Such 

a  family  is  called  a  normal  family.  Hence,  there  exists  a  subsequence 

£i  0  and  an  analytic  function  f  such  that 
m 


-*  £  unlfoxnly  on  compact  sets  of  the  complex  plane.  [8] 
m 

We  will  work  only  with  the  noisy  case  as  It  was  pointed  out  at  the  end  of 
Section  II. a.  The  non-noise  case  can  be  shown  by  exactly  the  same  proofs. 


Theorem  1  (proof) 

We  are  given  g(t),  a  noisy  piece  of  £(t),  for  t  £  [-T,  T] .  We  know 
g(t)  «  f(t)  +l^(t)  where  rj  is  a  continuous  function  l*^(t)l4  S  .  We  are  given 
€  >  2^  and  we  know  by  lemma  1  given  above  that  there  exists  such  that 

I  (x)  -  f(x)  I  4  if  X  6  [-T,  T],  m  ^  m^(S) 
in 

In  particular,  we  have 

Recall  that  ^ 

K  •  i  ;  by  (A9) 

m  m  k>-k  m 

o 

and  since 

I  f(nAj  -  g(nAj  1  4  S 


S  *  I .  -  g(nA^)  |56  ,  n  e 

Q  lC**iC 


(AlO) 


(AlO)  implies  that 


Iv®!  4  oc)| 

c«-k  ^  k—k  m 


-*b 


(All) 


because  of  properties  (13a)  and  (13b)  which  satisfies.  Now,  if  we 

n 

extend  formula  (12)  for  complex  argtsnents  z  we  will  get 


m  m  k«-k  m 


(A12) 


By  (All)  we  have 


/  ^ 

m  m\  k«-k 


[imzl A 


(A13) 


It  was  shown  in  lemma  1  that 


5  1°  I  (It)  I  4  e 


‘Ok— k  “m 
o 


Hence, 


I  Ya  (»  1  4  Cj  . 


limzl  n 


(A14) 


Then,  V’,  >  normal  family  of  analytic  functions  in  the  complex  plane. 

*  A_ 

111 

This  means  that  there  exists  a  subsequence  A  of  &  :  ^  -f  0  and  an 

m|Q  m  mj^ 

analytic  function  h 

»  h  uniformly  on  compact  sets  in  the  complex  plane. 

“k 

In  particular,  the  convergence  is  also  pointwise.  Then 


IhoUc.l®”'*^ 


(A15) 


(A15)  shows  that  h(x),  x  6  H  defines  a  bounded  function  of  Cl- exponent ial- 
type.  In  that  case,  the  distributional  Fourier  transform  is  known  to  be 
supported  in  (see  [9]). 


Ill .24 


It  can  be  easily  proven  that  [h(x)  -  g(x)|  ^  S ,  for  x  €  [-T,  T]  because  ^ 
Is  a  continuous  function  and  ^  is  a  family  of  equicontinuous  functions 
(see  [8]). 

Theorem  2  (proof) 

The  proof  of  this  theorem  is  very  similar  to  that  of  theorem  I.  We 
will  Just  point  out  the  differences  with  respect  to  the  proof  of  theorem  1. 
Formula  (All)  should  be  replaced  by  the  following  one: 


k=-k  m  k»-k  “ 

o  o 


(AH') 


In  this  case  the  family  of  functions  should  be  bounded  in  the  following 


lYi  <^)|  ■  5  I  1°  W  •  • 

**  t _ f- 


2trik2/M  a  I 

m  m 


k»-k  o 
o 


K.  “-‘'o  “ 


(A13') 


Then,  since 


I  liCi  Wl  6 


k*-k  ® 
o 


n— N 

L  n  J 


(A13')  becomes 


a  U  n— N_  J 


Since  f  has  finite  energy  (because  it  is  continuous  and  absolutely  summable) 


we  get 
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lie, 


(A14') 


and  therefore  ^  Is  a  normal  family  of  analytic  functions.  The  theorem 
“ 

is  proven. 

In  order  to  keep  the  conceptual  relationship  among  the  therems'  proofs 
we  would  like  to  prove  theorem  4  before  theorem  3. 


Theorem  4  (proof) 

It  was  proven  in  lemma  1  that  there  exists  a  sequence  A,  0  such  that 

SI 

-*»  f  imiformly  on  compact  sets.  Let  be  the  following  real  number 


I  V^A  I  “  ^m 

x€(-T,T]  ® 


Now,  taking  into  account  properties  (I6a)  and  (16b)  we  conclude 


Z  1  1  ^  Z  I  1 

k— k  ®n  k— k  % 


(A16) 


It  can  be  easily  shown  from  (A16)  that  ^  is  a  family  of  normal  analytic 

m*  m 

functions  on  the  complex  plane.  Hence  4^^  ^  >*>  K  where  K  is  an  analytic 

®v/  ®k 

function  and  the  convergence  is  uniform  on  compact  sets  in  the 

complex  plane.  It  remains  to  prove  that  f(x)  «  K(x) .  In  doing  that  it  is 
sufficient  to  show  that  f(x)  «  K(x)  when  x  £  [-T,  T]  since  both  functions 
are  analytic. 

Recall  that  a  normal  family  of  analytic  functions  is  equlcontlnuous 
([8]).  Then,  let  x^  be  any  point  in  [-T,  T] ,  and  c  be  any  positive  number. 
There  exists  S  >  0  such  that 
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1  X  -  X  -^lf(x)  -  f(x  )[  ^  c. 


(A17) 


“k  “k 


k  “k 


This  last  property  la  due  to  the  equlcontlnuous  property  of  the  family 

^  .  In  addition,  there  exists  m^  such  that 
®k*  “k  '  ® 


"  “k  “k 


Then,  A  can  be  chosen  small  enough  such  that  [nA  •  x  i  <.  S  for  certain  n, 
®k  ^  ®k  ° 

and  6  <  c.  If  we  put  nA  “  x, »  we  will  get 

®k  ^k  ^ 


I  1  4  -  't'i  .6  I  *  I  .6  '*o>  -  V  ,S 

®k  ®k  X  %  %  ®k 


*|Va  ,6  +  l*(V  -  *(Vt 

“k  ®k 

Hence,  ls(x  )  -  K(x  )l  4  Ac.  Since  c  is  any  positive  ntadjer,  f(x  )  »  K(x  ). 

0  0*  00 

We  will  need  the  following  lemma  to  prove  theorem  3.  This  lemma  is 
a  well  known  result  which  comes  from  the  general  Hilbert  space  theory  and 
it  will  not  be  proven  here.  For  a  proof  see  [10]. 


Lemma  2 

Let  H  be  a  Hilbert  space  and  let  x^.  ...,  n** linearly  independent 

elements  of  H.  Let  us  consider  the  following  optimization  problem: 


min  ^x,  x^ 


(A19) 
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NL 
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subject  to 


<x,  1  -  1,  n 


(A20: 


vhere  o{^  are  arbitrary  nuo^ers  and  <  »  >  denotes  the  inner  product  defined 
in  H.  Then,  the  solution  of  such  optimisation  problem  is  given  by 


n 

*  ■  *  (A21: 

i-1  ^ 

where  i  >  1,  n  are  complex  nuadaers  which  satisfy  the  following 

system  of  equations: 

n 


L  Pi<*i»  *1^  “  ®^J  »  i  "  1.  •••» 


(A22) 


i-1 


We  will  use  the  result  stated  in  lemma  2  in  the  following  particular 


case: 


H  - 


f:  f  \f[  dc«<ae>  ;<f,  g>-^  T 

-'-a 


a 


A  A 

f  g 


Xj^  -  x^(«))  -  e  ,  k  €  [-L.  L]  ,  a»6(-n,a) 
is  any  complex  number:  |  -  g(hi^)  [  4  €  . 


Now,  the  optimization  problem  given  by  (A19)  and  (A20}  becomes 


subject  to 

_1_ 

?Sr 


/  f(w)  dcu  -  , 


k  €  r-L,  Ll 


(A2i; 


(A22' 
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In  other  words,  given  k  €  [-L,  L]  we  seek  for  the  mlnioum-norm  band- 
limited  function  K  such  that  K(kA)  » *<j^.  Equations  (A21)  and  (A22)  describe 
this  problem  in  terms  of  K  (its  Fourier  transform).  On  the  other  hand,  the 
solution  of  (A21)  and  (A22)  is  given  by 


K(t«) 


k€[-L,L] 


i^kA 


(A23) 


^ere  satisfies 


k«[-L,L] 


^k  (i-k)A^l  “  is  [-L.  Ll 


(A24) 


This  means  that 


K(x)  •  JL.  p.  sine  (x  -  kA) 
k6[-L,L]  * 


and  P,  satisfies  (A24) .  Now,  theorem  readily  follows. 


Theorem  3  (proof) 

We  consider  the  following  additional  optimization  problem 
min  1\k  I 

^  _ 

where  K  satisfies  (A23),  satisfies  (A24)  and  has  the  following  property. 
Hv  "  80^)  Us  ,  k  €  [-L,  Lj 


Since 


llKi 


^2  “  ^  ®^k'®k  » 

2  fc€(-L,Lj  ^ 


k 
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we  obtain  the  following  equivalent  optimization  problem: 


minimize 


fc<[-L,L] 


k^k 


(A25) 


subject  to 


I  X  -  g(kA)|4  €  .  k  €  [-L,  L] 


(A26) 


Z  ainc^[A(l  -  k)]-  -  ,  he  [-L,  Ll 


k6f-L,L] 


(A27) 


The  last  three  conditions,  (A25),  (A26)  and  (A27),  show  that  the  optimization 
problem  (14a),  (14b)  and  (14c)  does  solve  the  minimum-norm  Q-band- limited 
function  K  such  that 


1  K(kA)  g(kA)  I  4  €  ,  k  6  [-L,  L]  . 


where  g(x)  »  f(x)  +  T|(x),  x  e  ("T*  Tj,  Vj  la  a  continuous  function  which 
satisfies  (v|(x)|^e.  Let  us  call  this  optimal  function  which  given  by  (A 23) 
Since  lf(kA)  -  g(k&}|4  €  >  It  turns  out  that 


(A28) 


NOW,  we  follow  the  same  technique  given  In  theorems  1,  2  and  4.  This 
technique  was  also  the  same  as  that  of  [3].  The  family  of  functions 


C 

2T  / 


f ,(«)  d«  . 


where  z  la  a  complex  parameter,  constitutes  a  normal  family  of  analytic 
functions.  This  readily  follows  from  (A28)  and  from  the  Schwartz  Inequality 
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I  f^(*)  I  ^ 


Then,  (A29)  becomes 


I  f  (z)l  L  c  llfll  .el^*^^ 

A.  2 


(A29) 


(A30) 


Now,  there  exists  a  siibsequence  0  such  that  approaches  an  analytic 

function  S  uniformly  on  compact  subsets  In  the  complex  plane.  From  (A30) 
we  obtain 

lS(2)l  4  cHfU.e*^*^  (A31) 

2 

(A31}  shows  that  S  Is  band- limited  to  This  assertion  is  a  conse- 

3 

quence  of  the  Fayley-Wlener  theorem  (see  [9]).  In  addition,  since  f^  Is 

m 

a  family  of  equlcontlnuous  functions  it  Is  readily  shown  that  . 


I  S(x)  -  g(x)  (4  €  ,  X  6  I-T,  T]  . 


(A32) 


Now,  we  will  show  that  f^  converges  to  S  uniformly  on  the  whole  real  line. 
First,  S  also  has  finite  energy.  This  is  a  consequence  of  Fatou's  lenaaa 
(see  [11])  which  states 

/•moo 


L 


ls(x)l  dx  4 


11m  / 

^  •  oe 


(f^(x)[  dxiiifa' 


(A33) 


Since  S  has  finite  energy  and  satisfies  (A32),  we  have  (If^^a  ^  Xsi 

B  2  2 

Putting  (A33)  and  this  last  Inequality  together  we  will  get 


This  shows 
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lin  Ilf*  tf  -  llsll. 
^  "*0  IB  ^  2 


But,  since  converges  to  S  pointwlse  we  also  have  convergence  In  the 

“m 

Been, 


(X)  -  S(x) 


0 

0 


(see  [121) 


Now,  It  Is  well-known  that  If  a  fasilly  of  Q-band- lialted  functions  converges 

In  the  energy-norai  to  another  CL-band- limited  function  S(x>  then  It  converges 

to  S(x)  uniformly  on  the  whole  real  line.  Let  us  suppose  that  L  Is  any  finite- 

energy  Cl-band-llmlted  function  such  that  [L(x)  -  g(x)|4  6  ,  for  all  x  6.  [-T,  T] . 

Then,  It  la  clear  that  If.  I  4  %  lI .  Therefore,  Kstl  4llLli  .  That  shows 

2  ^2  22 

that  S  has  the  minimum-energy  property  among  all  the  A-band- limited  functions 
which  are  €  apart  from  g  on  [-T,  T] . 


Theorem  5  (proof) 

It  Is  clear  that  the  problem  we  need  to  solve  Is  linear.  That  is  to  say. 
It  will  be  enough  to  find  ^  such  that 


and 


I  Vc,P<^>  I  >  ® 


(A34a) 

(A34b) 


Let  f  be  a  smooth  function  (say  C**)  which  vanishes  outside  (-12,(1).  In  that 


ease 
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IttlZ 

f(u»)  e  duu 

•a 

gives  a  n.'-band* limited  function  which.  In  addition,  satisfies 

I  f(z)l  4  Cjj(l  +  1*1)”  •  e^^'^  .  (A35) 

where  N  Is  any  negative  Integer  nus^er  and  Is  a  constant  which  depends  only 
on  N  end  f  but  not  on  *.  (This  Is  a  special  case  of  the  Fayley-Wlener  theorem 
which  also  assures  that  the  converse  property  holds, [9]}.  Property  (A35) 
shows  that  f  (x)  goes  to  zero  at  Infinity,  x  6  R  even  when  It  Is  multiplied  by 
any  polynomial:  (1  +  |x()*'”.  Now,  it  Is  obvious  that  we  can  assume 

(  f(P)|  »  |f(x)I  .  X  ^r-T.  T]. 

and  therefore  we  can  suppose  that 


1  f  (P)  I  >  1  and  1  f  (X)  I  I  ,  X  €.  t-T,  T] . 


Now 


,  we  put  f^(s)  •  f(*),  with  P>Tj^-T+5  >T. 

I. 

II  f  ll^  0  ,  n  «w 

n  «9 


It  Is  clear  that 


and 


Now,  we  Just  need  to  pick  up  n  adequately  to  satisfy  conditions  (A34a)  and 
(A34b).  In  addition.  It  Is  seen  that  p  Is  not  only  A-band- limited  but 

also  has  the  same  property  (A34)  as  f(z)'  .  1 
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ABSTRACT 

In  this  paper,  savaral  raanlts  coneaming  iterative  algor itbas  for  band- 
liaited  signal  extrapolation  are  presented.  We  first  prove  tbat  tbe  well- 
known  Gercbberg-Paponlis  algoritlia  ([1],.(2]):  g^  «  sincQ  *  (g  (I  -  T) g^^^) 
is  a  special  ease  of  an  algor itba  given  by  Landweber  in  19S1  ([3]).  Tben  we 
will  generalize  tbe  recursive  foraula  g^  *  sincQ  *  (g  to  eases 

wbere  tbe  low-pass  operator  sincQ  i«  replaced  by  soae  other  low-pass  filters. 
Finally,  we  show  tbe  relationsbip  between  tbis  generalization  and  some 
discrete  teebniques  for  solving  tbe  extrapolation  problea  given  in  [41 . 


IV.l 


fnr?  aTTTa^TTTf  f  fWx?  ITT?0  I 


•CTrmrri 


The  band-liaited  signal  sztrspolntion  problm  was  addzassed  by  several 
anthers  and  several  algorithas  were  given  ((1]«  [2],  [4],  [5]*  [6]*  [7]  and 
110]  aaong  others) .  Probably  the  best  known  teehniqne  for  solving  the  problem 
is  the  Gerehberg  Paponlis  algoritha: 


*o-® 


‘a  "  *^“0  •  (g  >  (I  -  .  a  2  0 


lAere  g  :  (-A«A)  C  is  a  piece  of  a  O-band-liaited  signal »  denotes  the 
trnncation  operator  to  (-A«A) ,  I  denotes  the  identity#  sine^  the  function 
whose  Fourier  transfora  is  the  indicator  of  and  *  denotes  convolution. 
It  is  well  known  that  g  converges  to  g  in  the  energy  nora* 


J  lg„(z)  -  g(x)|*  dx  -►O 


•  n  * 


In  particular,  g^  will  approach  g  uniforaly  over  the  real  line  because  these 
functions  are  band**liaited  to  (-&,&) .  Equation  (1)  can  be  written  in  this 
equivalent  fora 


*o  -  ® 


•n  ■  tn-l  *  •  Ja<*  ”  Itt-l^*  ®  ^  ® 


Since  f-  g  in  the  energy  nora,  g.  f  ia  the  energy  nora.  ( ^  indicates 
Fourier  transfora.)  We  now  take  the  Fourier  transfora  of  both  terms  in  equa¬ 
tion  (2)  to  obtain: 


'o-O 


Vi  ♦  "  V> 


(3) 


■i  iT. 


wkexe  denotes  the  inverse  Fourier  trsnsfora.  Since  •  0,  it  u  i 

«e  esn  write 


«n(*»)  -  J  "  J  ****“^“  ^n-l<*^  ,-2nixn  ^ 

<4) 

where  m  s  (-fl«fl) . 

Since  then  it  is  clear  that  conwerges  to  f  in  L^(fi)»  where  £ 

satisfies 


J  £(»)  t'^nixu  .  g(x)»  X  s  (-A,A)  (5) 

■'-0 

Equation  (S)  defines  f  uniquely*  and  the  solution  exists  because  we  assusied  g 
to  be  band-liaited  to  (-0*0).  If  we  denote  C(x*«)  e'*^’’^***  x  s  (-A*A)«  «»  s 

we  will  be  able  to  write  the  following  equation  which  is  equivalent  to 

(5); 

r 

J  K(x««)  f(«)  d«  »  g(x)*  X  s  (-~A*A)  (6) 

^-0 

fe  recognise  equation  (6)  to  be  a  Fredholn  integral  equation  of  the  first 
hind*  where  K  defines  a  cosipaet  operator*  E  :  L^(fi)  L^(A).  In  1951* 


Landweber  ([3])  proposed  the  following  iterative  procedure  for  eonputing  the 
solution  f  to  equation  (d)  where  E  is  any  conpaet  integral  oporator: 


..V  ..  V..  V 


< 

*v 


*,-0 

-  Vl  ♦  **<»  -  “r-l>  •  •  i  0 


Here*  E*  denotes  the  sdjoiat  of  E(C*  :  L^(A)*^  L^(0)).  Leadeebex  proved  that 
if  equation  (6)  baa  a  solution  and  the  solution  is  unique  :  f*  then  f^  will 
approach -f  in  the  energy  non  over  (-Q*0) .  For  the  ease  K(z*«*)  •  0**2]iizH^  £* 
is  also  given  by  the  integral  kernel  Therefore*  equation  (7)  becones 


fo  -  0 

+  J  e^“**“ig(x>  -  J  f(x)  dx)*  n  >  0 


It  turns  out  that  (8)  and  (4)  define  the  sane  iterative  fonula. 

In  conclusion*  ve  have  proven  that  the  Gerchberg-Papoulis  technique  is 
obtained  froa  Laadveber's  iteration  by  replacing  E(x*m)  ■  ^'Zitixu  equation 
(7).  In  fact*  Landveber  also  proved  ([3])  that  iteration  (7)  converges  to  the 
nininua  noxa  solution  in  eases  where  (6)  has  aultiple  solutions.  However* 
this  extension  is  not  useful  for  our  situation  because  the  solution  to  equa¬ 
tion  (S)  is  unique. 

Soae  interesting  consequences  can  be  drawn  froa  our  result.  Perhaps  the 
aost  iaportant  observation  froa  a  theoretical  point  of  view  is  related  to  the 
role  played  by  the  Prolate  Spheroidal  lave  functions  ([10]).  The  proof  of  the 
convergence  of  iteration  (1)  given  in  [2]  uses  the  coapleteness  of  the  pre¬ 
lates  in  the  space  of  O-band-liaited  functions.  However*  this  property  does 
not  hold  for  all  the  kernels  K.  Therefore  our  result  shows  that  the  conver¬ 
gence  of  (2)  can  be  proved  by  using  a  conceptually  simpler  approach.  This 


reaark  shows  that  iteration  (2)  do« 


any  particular  or  special  pro- 
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perty  whieli  is  satisfied  by  e"2nix»  only.  On  the  other  hand,  in  order  to 
prove  the  equivalence  of  (1)  and  (2)  ve  do  need  the  property 

sincjj  •  g  -  g 

where  g  is  any  Q-band-linited  function.  However,  the  convenience  of  using  (2) 
instead  of  (1)  was  shown  by  several  authors  through  theoretical  and  practical 
evidence  (see  for  example,  [5],  [8],  [9]). 

Since  iteration  (7)  converges  for  any  compact  integral  operator,  the 

iterative  procedure  (2)  can  be  generalized  for  getting  the  continuation  of  g 

when  it  is  given  by  equation  (6) .  Some  other  regularity  conditions  are 

required  for  K  (for  a  detailed  discussion*  see  [11]).  This  means  that  if  g  is 

an  analytic  function  given  by  (6),  g  can  be  extrapolated  by  means  of  the  fol- 

« 

lowing  iterative  procedure; 

go  -  0 

*n  •  *n-l  *  »  2  0  (9) 

The  convergence  of  g^  to  g,  xuiformly  over  compact  sets  in  C,  is  easily 
proved.  It  is  worth  pointing  out  that  if  K(x,u)  ■  ,"2nixm  then  KK  (g  -  Sn-i) 
■  sincg  •  J^(g  -  go_i)  and  therefore  (9)  will  be  the  same  iteration  as  that  of 
formula  (2) . 

Equation  (9)  allows  ns  to  consider  new  iterative  procedures  when  some 
more  ±  priori  information  about  g  is  available.  The  purpose  of  the  next  sec¬ 
tion  is  to  relate  some  of  these  generalizations  to  some  discrete  procedures 
given  in  [4] . 
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If  we  sample  eqnation  (2)  as  follows: 


S.(k)  -  0  .  for  all  k  s  Z 

+  A  2_  siiiCa[(k-j)A](g(jA)  -  S^,i(j)) 

jAs(**A.A) 

we  will  obtain  a  very  well-known  iterative  procedure  for  getting  a  solution  of 
tke  discrete  extrapolation  problem  ([4]*  [6]  and  [7]).  Tbis  algorithm  was 
generalized  in  [4]  to  eases  where  the  low-pass  operator  is  replaced  by  some 
other  low-pass  filters.  Specifically*  if  h  :  K.  -»■  C  is  a  finite-energy  func¬ 
tion  which  is  band-limited  to  (-0*0)  and  satisfies  0  <  h(u)  ^  1  for  all  u  e 
(-11. Q)*  then  the  following  iteration  converges  to  a  certain  solution  of  the 
discrete  extrapolation  problem: 


t.(k)  «  0  .  for  all  k  s  Z 

®  (11 

k  e  Z,  t  (k)  -  t__i(k)  +  A  X!  h[(k-j)A](g(jA)  -  t_  .(j)) 

“  “  ^  jAs(-A,A)  “  ^ 

It  is  clear  that  equation  (10)  is  a  particular  case  of  (11) .  It  was  also 
shown  in  [4]  that  the  limit  of  the  iterative  equation  (11)  approaches  the  con¬ 
tinuous  extrapolation  when  A  tends  to  zero  and  when  f  and  h  satisfy  the  fol¬ 
lowing  relationship: 

f  “  ^  dm  <  -  (12) 

''-lllh(m)| 

(f  is  the  Fourier  transform  of  g.)  It  is  worth  pointing  out  that  equation 
(10)  was  obtained  by  sampling  a  continuous  iterative  equation.  On  the  other 
hand,  iteration  (11)  was  not  obtained  by  sampling  any  recursion. 


Tao  purpose  of  tne  remainder  of  this  section  is  to  show  that  iteration 
(11)  does  come  from  sampling  a  continnons  iterative  equation  similar  to  (2) 
which  also  computes  the  continnons  extrapolation  of  g.  This  result  will  also 
help  ns  understand  the  origin  of  condition  (12) .  Let  ns  assume  that  f  and  h 
satisfy 


f  “  lf(m)P 

Lq  £(„) 


dm  <  • 


Condition  (13)  is  weaker  than  (12)  because  0  <  h(u)  i  1.  Ve  now  write 

H(x.«)  -  e“2ni«*  ,  (_A.A) 

tt  a  (-Q.Q) 


It  is  easy  to  verify  that  H  defines  a  compact  integral  operator  from  L^(a) 
into  L  (A) .  It  is  also  seen  that  the  integral  equation 

r  0 

I  H(x.tt)  1  (u)  du  «  g(x)  ,  X  a  (-A.A)  (15 

2  1 

has  one  and  only  one  solution  in  L^(a).  Moreover,  the  solution  is  just  f(u)/h 

(m)  which  belongs  to  L^(0)  because  property  (13)  holds.  We  are  now  able  to 
apply  Landweber's  iteration  to  equation  (15)  for  getting  the  solution  I  and  to 
apply  extrapolation  procedure  (9)  for  obtaining  the  extrapolation  of  g.  If  we 
use  the  latter  technique,  we  will  get 


*0-0 

•n  -  •n-l  ”  •n-1^  »  “  i  0 


It  is  easy  to  verify  that  HH  (g  -  g^_^)  -as  j^(g  -  therefore  (9) 


becomes 
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*®  °  (16) 
•n  •  »n-l  +  ^  “  *n-l>  •  »  ^  ® 

In  this  psrtienlsr  situs tlon,  will  spproseh  g  unifonly  oyer  the  real  line. 

This  fact  readily  follows  from  the  fora  of  the  kernel  H  and  the  eonrergence  in 
of  the  corresponding  Landweber’s  iteration.'  Equation  (16)  is  an  exten¬ 
sion  of  iterative  procedure  (2)  where  tincQ  is  replaced  by  h.  It  turns  out 
that  the  discrete  iterative  algorithm  defined  by  equation  (11)  can  be  obtained 
by  saapling  the  continuous  recursion  (16).  This  gives  a  full  explanation  of 
the  conceptual  origin  of  the  discrete  technique  (11). 

As  was  pointed  out  above*  condition  (13)  is  weaker  than  (12)  but  it  is 
strong  enough  to  prove  the  convergence  of  (16)  to  the  sought  function  g.  This 
suggests  that'  the  discrete  technique  given  by  (11)  should  also  approach  the 
extrapolation  if 


f  “ 

^-0  £(a) 


du  <  • 


Ve  proved  this  proposition  in  a  wore  general  setting  in  ref.  [11]. 


Refetence* 


[1]  R.  W.  G«rcliberg<  "Super-Resolntioa  throngli  Error  Energy  Reduction," 
tioa  Acte,  vol.  21,  no.  9,  pp.  709-720,  1974. 

[2]  A.  Pepoulis,  "A  New  Algoritha  in  Spectral  Analysis  and  Band-linited  Ex¬ 
trapolation,"  IEEE  Trans.  Circuits  Syst.,  vol.  CAS-22,  no.  9,  pp.  735- 
742,  Sept.  1975. 

[3]  L.  Landveber,  "An  Iteration  Foraiula  for  Fredbola  Integral  Equations  of 
tbe  First  Rind,"  Asier.  J.  Matb.  73,  pp.  615-624  (1951). 

[4]  J.  L.  C.  Sanz  and  T.  S.  Huang,  "Discrete  and  Continuous  Band-liaited 
Signal  Extrapolation,"  subaitted  to  IEEE  Trans.  Acoust.,  Speech,  Signal 
Proc.,  1982. 

[5]  J.  Cadzov,  "An  Extrapolation  Procedure  for  Band-liaited  Signals,"  IEEE 
Trans.  Acoust.,  Speech,  Signal  Proc.,  vol.  ASSP-27,  No.  1,  February 
1979. 

[6]  J.  L.  C.  Sanz  and  T.  S.  Huang,  "Soae  Aspects  of  Band-liaited  Signal  Ex¬ 
trapolation:  Models,  Discrete  Approxiaations  and  Noise,"  subaitted  to 

IEEE  Trans.  Acoust.,  Speech,  Signal  Proc.,  1982. 

[7]  A.  K.  Jain  and  S.  Ranganath,  "Extrapolation  Algorithas  for  Discrete  Sig¬ 
nals  with  Applications  in  Spectral  Estiaation,"  IEEE  Trans.  Acoust., 
Speech,  Signal  Proc.,  vol.  ASSP-29,  no.  4,  August  1981. 

[8]  R.  Schaefer,  R.  Mersereau  and  N.  Richards,  "Constrained  Iterative  Res¬ 
toration  Algorithas,"  Proc.  IEEE,  vol.  69,  p.  432-450,  April  1981. 

[9]  T.  S.  Huang,  J.  L.  C.  Sanz,  H.  Fan,  J.  Shafii  and  B.  Tsai.  "Nnaerical 
Coaparison  of  Several  Algorithas  for  Band-liaited  Signal  Extrapolation," 
in  preparation. 

[10]  0.  Slepian  and  H.  0.  Poliak,  "Prolate  Spheroidal  Wave  Functions  (I)," 
Bell  Syst.  Tech.  J.,  vol.  40,  pp.  43-63,  Jan.  1961. 

[11]  J.  L.  C.  Sanz  and  T.  S.  Huang,  "Continuation  Techniques  for  a  Certain 
Class  of  Analytic  Functions,"  subaitted  to  SIAM  J.  on  Applied  Matheaat- 
ics. 


